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COMPARISON  OF  RATING  SCALE  METHODS  FOR  APPLICATION  IN 
DISCRIMINATING  05H  (MORSE  INTERCEPT  OPERATOR)  PERFORMANCE 

Frances  L.  Carter,  Beverly  G.  Knapp  and  Vanessa  C.  Irizarry 
U.S.  Army  Research  Institute 

Overview 

The  project  described  herein  is  part  of  an  ongoing  research 
effort  by  the  Intelligence  Research  Group  within  the  Systems 
Research  Laboratory  at  ARI .  This  group  is  concerned  with  the 
measurement  and  assessment  of  military  intelligence  personnel,  the 
results  being  utilized  for  the  improvement  of  systems  design  and 
training  procedures. 

Introduction 

AS  part  of  its  continuing  efforts  to  improve  efficiency,  the 
US  Army  Intelligence  School -Devens  (USAISD)  seeks  to  reduce  the 
attrition  in  its  Morse  code  intercept  operator  course  (MOS  05H). 

Asked  by  USAISD  to  assist,  the  Army  Research  institute  (ARI)  developed 
a  psychological  test  battery  and  rating  scales  to  characterize  05H 
performance.  This  profile  may  eventually  be  utilized  to  select 
personnel  who  are  likely  to  succeed  during  05H  training  and  in  the 
field.  It  may  also  function  to  point  out  weak  or  missing  areas  in  the 
current  training  program  which  can  then  be  revised  and  strengthened. 
This  paper  describes  the  review  and  selection  process  undertaken  to 
develop  the  rating  scales  for  this  project. 

The  ARI  OSH  psychological  profiles  project  required  the 
development  of  two  separate  rating  scales.  The  first  scale  was 
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to  determine  the  degree  of  association  between  05H  instructor 
ratings  (of  students  in  the  05H  training  course)  and  success/failure 
of  students  in  the  05H  course.  The  second  rating  scale  was 
administered  to  05H  supervisors  to  obtain  evaluations  concerning  the 
quality  of  on-the-job  performance  of  individual  05H  operators. 

One  of  the  constraints  in  developing  the  scales  was  that  time  to 
administer  the  scales  in  the  operational  setting  was  limited, 
therefore  options  for  the  types  of  scales  to  be  considered  were 
guided  by  this  criterion. 

Method:  Comparison  of  Rating  Scale  Methods 

Three  scaling  methods  were  reviewed  from  the  pertinent 
literature  (Schwab,  Heneman,  DeCotiis,  1975)  which  appeared 
appropriate  for  use  in  assessing  05H  performance:  Behaviorally 
anchored  rating  scales  (BARS),  behavioral  observation  scales  (BOS), 
and  graphic  rating  scales  (GRS). 

BARS 

For  the  BARS,  while  there  are  minor  variations  in  the 
procedure  employed,  scale  development  normally  includes  five 
stages.  The  first  is  the  identification  of  critical  incidents. 
Individuals  who  are  knowledgable  of  the  job  to  be  investigated 
(job  holders  and/or  supervisors)  are  asked  to  provide  specific 
examples  of  effective  and  ineffective  job  performance  behavior. 

The  second  step  involves  clustering  the  obtained  incidents  into 
a  smaller  set  of  performance  dimensions,  which  are  typically 
defined  also.  Then  a  second  group  of  job  experts  are  asked  to 
retranslate  the  critical  incidents:-  In  other  words,  they  are 
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given  a  list  of  the  performance  dimensions  and  the  behavior 
examples  and  asked  to  assign  each  incident  to  the  dimension  which 
best  describes  it.  This  step  helps  determine  which  incidents  will 
be  included  in  the  final  scale.  An  incident  is  retained  if  some 
percentage  of  the  group  (usually  50-80%)  assigns  it  to  the  same 
dimension  as  did  the  group  in  the  second  step.  This  second  group 
is  usually  also  asked  to  rate  each  behavioral  incident  on  how 
effectively  or  ineffectively  it  represents  performance  on  the 
appropriate  dimension.  The  average  rating  assigned  (on  a  7-  or 
9-point  scale)  indicates  the  degree  to  which  the  incident  describes 
effective  performance  and  the  standard  deviation  represents  the 
amount  of  agreement  among  raters  regarding  the  effectiveness  level 
described  by  the  incident  (the  lower  the  standard  deviation,  the 
greater  the  agreement).  A  standard  deviation  cut-off  is  then  set 
(normally  1.50  and  less)  for  deciding  which  incidents  will  be 
retained  for  the  final  instrument.  The  final  BARS  instrument 
consists  of  a  series  of  scales,  one  for  each  dimension,  anchored 
with  the  retained  incidents. 

There  is  some  disagreement  in  the  literature  (Jacobs,  Kafry 
Zedeck,  1980)  concerning  the  psychometric  properties  of 
behavior  -  based  scales,  like  Behaviorally  Anchored  Rating  Scales 
(BARS)  and  Behavioral  Observation  Scales  (BOS),  compared  to  other 
rating  scale  methods.  Researchers  have  hypothesized  that  halo  error 
would  decrease  with  the  BARS  due  to  more  clearly  defined  performance 
dimensions  and  that  leniency  error  would  decrease  because  levels  of 
performance  are  clarified.  Some  studies  (Campbell,  Dunnette,  Arvey 
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Hellervik,  1973;  Borman  Dunnette,  1975;  Keaveny  McGann, 

1975;  Finley,  Osburn,  Dubin  Jeanneret,  1977)  have  reported 
superiority  of  BARS  over  other  scales  with  respect  to  halo  and 
leniency  errors.  However,  several  researchers  (Burnaska 
Holloman,  1974;  Bernardin,  LaShells,  Smith  Alvares,  1976; 
Bernardin,  1977)  found  no  differences  between  rating  formats. 
Others  (Borman  Vallon,  1974;  Saal  Landy,  1977)  showed  the 
BARS  to  be  inferior  to  other  scales  on  leniency  and  halo. 

Similarly  ambiguous  results  were  found  on  interrater  reliability 
(typically  ranging  from  .52  to  .76)  and  ratee  differentiation 
of  the  BARS. 

BOS 

The  description  and  construction  of  the  Behavioral 
Observation  Scale  is  similar  to  the  BARS  in  many  aspects.  The 
BOS  also  requires  experts  to  identify  the  critical  observable 
behavior  incidents  as  they  relate  to  performance  and  assign  them 
scale  values  indicating  effective  or  ineffective  performance. 

But  instead  of  asking  the  rater  what  the  ratee  is  expected  to  do 
(as  in  the  BARS),  the  BOS  asks  how  frequently  a  ratee  has  been 
observed  performing  a  particular  critical  behavior  (on  a  5-  or 
7-point  scale).  The  logic  is  that  a  better  worker  will  more 
frequently  engage  in  behaviors  critical  to  job  success  than  poorer 
performers.  Evaluation  of  a  ratee's  performance  on  a  particular 
dimension  is  derived  by  summing  the  frequency  ratings  of  each 
behavior  in  that  dimension. 

Behavioral  Observation  Scales  have  been  proposed  by  Latham 
and  Wexley  (1977)  to  be  a  useful  performance  appraisal  tool. 
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Even  though  psychometric  comparisons  between  BOS  and  other  rating 
scales  have  been  inconclusive  (Bernardin  Kane,  1980),  BOS  has 
been  recommended  because  of  its  simplicity.  It  appears  to  simplify 
the  rater's  task  by  focusing  on  the  observation  of  ratee  behavior, 
whereas  judgemental  rating  scales  involve  more  complex  and  often 
unreliable  judgements  about  performance.  While  logical,  problems 
have  arisen  with  this  hypothesis.  A  study  by  Murphy,  Martin,  and 
Garcia  (1982)  suggests  that  the  recall  of  ratee  behavior  is  not  a 
simple  automatic  process,  but  instead  the  decisions  about  the 
frequency  of  observed  behaviors  over  a  span  of  time  are  formulated 
by  judgements,  general  impressions,  and  inferences. 

GRS 

The  description  and  construction  of  the  Graphic  Rating  Scale 
is  much  simpler  than  that  of  the  BOS  or  BARS.  There  are  numerous 
variations  of  the  GRS,  but  these  scales  mainly  differ  in  three 
ways:  1.  the  degree  to  which  the  meaning  of  the  response 

catagories  are  defined,  2.  the  degree  to  which  the  person  who  is 
interpreting  the  ratings  can  tell  what  response  was  intended,  and 
3.  the  degree  to  which  the  performance  dimension  being  rated  is 
defined  for  the  rater.  Some  scales  use  qualitative  end  anchors, 
some  use  numerical  and  verbal  anchors,  and  some  use  only  verbal 
anchors.  Occasionally  relevant  performance  statements  are  used 
to  anchor  the  GRS,  but  these  are  subjectively  chosen  by  the 
developer  and  do  not  go  through  a  rigorous  selection  process  like 


that  for  the  BOS  and  BARS. 
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Compared  to  the  BOS  and  BARS,  the  GRS  is  inexpensive,  quick 
and  easy  to  develop.  It  is  also  a  standardized  scale  and  is 
therefore  comparable  across  individuals.  The  imposing  disadvantage 
of  the  GRS  is  that  by  giving  maximum  control  to  the  rater,  it 
generally  provides  less  control  for  leniency,  central  tendency,  and 
halo  errors.  Much  of  the  above  noted  research  compared  behavior- 
based  scales  with  GRS  and  obtained  ambiguous  results.  In  numerous 
studies,  the  behavioral  scales  out-performed  the  GRS,  but  in  other 
instances  no  differences  were  detected  between  the  two  methods. 

Recommendations  Application: 

Selection  of  Scales  for  05H  Development 

Despite  some  arguments  against  the  BARS  and  BOS,  relating  to 
incidents  of  higher  halo  and  leniency  error,  they  both  have  many 
practical  considerations  which  make  them  appealing  choices.  Wiersma 
and  Latham  (1986)  emphasized  the  importance  of  the  practicality  of 
a  scale.  The  results  of  their  study  indicate  that  both  supervisors 
and  subordinates  prefer  behaviorally  anchored  scales,  particularly 
BOS.  In  this  respect,  "to  the  degree  that  an  appraisal  instrument 
is  not  acceptable  to  the  user,  it  will  not  be  used  properly" 

(p.  619).  The  BOS  was  preferred  because  it  minimized  personality 
disputes,  improved  rater-ratee  feedback,  allowed  raters  to  justify 
low  ratings  and  was  more  defensible  in  court  than  the  other  rating 
methods.  A  study  by  Silverman  and  Wexley  (1984)  found  that  the 
extensive  involvement  of  employees  and  supervisors  in  development 
of  the  BARS  can  result  in  more  positive  reactions  by  workers  to  the 
performance  appraisal  interview  as  well  as  subsequent  outcome 


measures . 
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As  a  result  of  the  literature  review  above  and  given  the  constraint 
stated  that  the  selected  scales  must  be  administered  in  a  timely 
fashion,  a  Behavioral  Observation  Scale  was  developed  to  be  employed 
by  05H  instructors,  and  a  Behaviorally  Anchored  Rating  Scale  was 
developed  for  use  by  05H  supervisors.  These  scales  are  presented 
in  Appendix  A.  While  modifications  in  the  development  of  the  BOS 
and  BARS  were  necessary  due  to  SME  (subject  matter  expert)  data 
availability,  these  methods  proved  to  be  the  most  useful  for  the 
stated  purpose  of  characterizing  05H  performance.  In  developing 
the  BOS  for  the  instructors,  information  was  obtained  from  25 
current  05H  instructors  from  the  US  Army  Intelligence  School -Devens 
(USAISD)  describing  behaviors  critical  to  the  success/failure  of  05H 
students.  Scales  representing  the  critical  aspects  of  the  job  were 
developed  and  presented  in  such  a  way  that  the  rater  was  to  indicate 
the  frequency  with  which  each  behavior  was  actually  observed.  Table  1 
lists  example  05H  performance  dimensions  and  the  critical  incidents  on 
the  BOS  related  to  them. 

The  BARS  was  developed  in  a  manner  similar  to  the  BOS.  Critical 
incidents  of  on-the-job  05H  operator  behavior  were  collected  from 
and  evaluated  by  12  05H  supervisors  obtained  from  USAISD  and  US  Army 
Intelligence  and  Security  Command  (INSCOM).  The  retranslation  of  the 
critical  incidents  was  performed  in-house.  Table  2  provides  several 
examples  of  the  types  of  incidents  used.  As  an  additional  check 
on  the  content  validity  of  both  the  BARS  and  the  BOS,  essentiality 
ratings  were  obtained  from  numerous  pilot  subjects.  This  involved 
the  rater  providing  a  rating  of  how  essential  each  item  on  the  scale 
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was  to  the  task  in  question.  In  conjunction  with  the  psychological 
test  battery  being  administered  to  05H  personnel,  the  rating  scales 
provided  the  needed  quantification  of  judgmental  data  regarding 
student  and  operator  performance. 

Summary 

The  rating  scales  developed  were  used  as  one  component  of  the 
ARI  05H  operator  and  student  profiles  effort  to  aid  in  reducing  AIT 
attrition.  Approximately  100  05H  operators  and  100  students  have 
been  assessed  using  the  scales.  Reports  containing  these  findings 
will  be  detailed  in  ARI  Working  Papers  87-07,  05H  Operator  Profile 
and  87-08,  05H  Student  Profile  (Knapp  et  al ,  1987). 

In  general,  behavior -based  rating  methods  can  be  seen  as  an 
extensive  job  analysis.  The  job  responsibilities/behaviors 
necessary  for  effective  05H  performance  were  clearly  defined  during 
the  development  of  the  scales.  This  information  delineates  the 
critical  skills  which  could  be  translated  into  a  training  program. 
According  to  Jacobs  et  al,  1980,  BARS  use  as  an  evaluative  tool 
in  performance  appraisal  needs  to  be  expanded  to  become  an 
essential  element  of  a  total  performance  evaluation  system.  It 
is  particularly  in  this  light  that  the  BARS  and  BOS  were  chosen  as 
the  rating  methods  for  the  05H  effort. 
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Performance  In  Training: 

*  Student  maintains  a  consistent  code  copy  rate 
throughout  a  day  (i.e.  consistent  passing  or 
failing  rate )  . 

*  Student  maintains  a  consistent  code  copy  rate 
throughout  the  course  (over  numerous  weeks). 

Motivation/Self -Discipline: 

*  Student  takes  responsibility  for  his/her  own 
performance  (i.e.  does  not  "give  up"  or  make 
excuses  for  poor  performance). 

*  Student  monitors  his/her  own  course  progress 
(i.e.  inspects  hourly  roster  of  scores  posted 
or  asks  instructor). 

Attention/Effort : 

*  Student  is  attentive  toward  the  instructor 
(i.e.  establishes  eye  contact;  asks  questions). 

*  Student  displays  effort  to  do  well  in  the  course 
(i.e.  seeks  assistance/feedback  from  the  instructor 
to  improve  performance). 


Table  1.  Examples  of  05H  Performance  Dimensions  and  Critical  Incidents 


*  Displays  the  knowledge/skills  required  to  perform  most 
job  assignments  and  tasks  properly,  but  may  need  help 
for  harder  tasks. 

*  Puts  in  the  extra  effort  and  keeps  trying  when  it's  very 
important  to  complete  assignments;  overcomes  obstacles/ 
adversities  on  the  job,  in  garrison  and  in  the  field. 

*  Completes  intercept  forms  and  logs,  and  reports  with 
few  errors;  helps  in  facilitating  follow-up  processing 
and  analysis. 

*  Performs  collector  analysis  adequately,  often  noticing 
suspect  items  of  intelligence  interest;  makes  few  computer 
generated  errors  that  can  be  attributed  to  the  operator. 


e  2.  Example  critical  incidents  in  the  BARS 


APPENDIX  A 


OSH  INSTRUCTOR 


SURVEY 


OSH  SUPERVISOR  SURVEY 


05H  Instructor  Survey 


Instructor's  Name: 
Student's  Name: 


PERFORMANCE  IN  TRAINING: 

*Student  maintains  a  consistent  code  copy  rate  throughout  a  day 
(ie.  consistent  passing  or  failing  rate). 


Almost 

Neve  r 

1 

2 

3 

4 

5 

Almost  Always 

*Student  maintains  a  consistent  code 
(over  numerous  weeks). 

copy 

rate 

throughout  the  course 

Almost 

Neve  r 

1 

2 

3 

4 

5 

Almost  Always 

*Student 

copies 

100%  of 

all 

messages 

sent 

(regardless  of  errors). 

Almost 

Never 

1 

2 

3 

4 

5 

Almost  Always 

*Student  diligently  copies  code  a  greater  percentage  of  the  hour 
relative  to  the  other  students. 

Almost  Never  12345  Almost  Always 


MOTIVATION/SELF-DISCIPLINE : 

*Student  takes  responsibility  for  his/her  own  performance  (ie.  does 
not  "give  up"  or  make  excuses  for  poor  performance). 

Almost  Never  12345  Almost  Always 

*Student  is  present  for  class  and  on  time  each  day. 

Almost  Never  12345  Almost  Always 

*Student  monitors  his/her  course  progress  (ie.  inspects  hourly  roster 
of  scores  posted;  asks  instructor). 

Almost  Never  12345  Almost  Always 

*Student  seems  to  provide  his/her  own  motivation  -  either  a 
positive  "pat  on  back"  or  negative  "kick  in  pants"  (ie.  does  not 
require  the  instructor's  motivation). 

Almost  Never  12345  Almost  Always 
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ATTENTION/EFFORT : 

*Student  is  attentive  toward  the  instructor  (ie.  establishes  eye 
contact;  asks  questions). 

Almost  Never  12345  Almost  Always 

*Student  reads  and  follows  instructions  (ie.  consistently  from  the 
start  of  the  course;  takes  2-3  weeks  to  realize  the  importance  of 
of  instructions). 

Almost  Never  12345  Almost  Always 

*Student  is  attentive  toward  the  task  at  hand  (ie.  hunches  determinedly 
over  the  keyboard  while  copying  code;  slouches  back  in  a  relaxed, 
unhurried  position). 

Almost  Never  12345  Almost  Always 

*Student  displays  effort  to  do  well  in  the  course  (ie.  seeks 
assistance/feedback  from  the  instructor  to  improve  performance). 

Almost  Never  12345  Almost  Always 

SOCIAL  BEHAVIOR: 

*Student  engages  in  social  activities  with  his/her  peers  outside  the 
classroom  (ie.  travels  downtown  on  weekends;  engages  in  sports, 
hobbies;  or  is  a  "barrack  rat"). 

Almost  Never  12345  Almost  Always 

*Student  engages  in  thrill -seeking,  outrageous  behavior  inside  or 


outside 

action. 

the  classroom 
etc . ) . 

(  ie . 

"practical 

jokes" 

requi ring 

disciplinary 

Almost 

Never  1 

2 

3  4 

5 

Almost 

Always 

Name : 


05H  SUPERVISOR  SURVEY 

TECHNICAL  KNOWLEDGE/SKILL: 

How  effective  is  each  operator  in  displaying  job  knowledge/skill? 

I  Does  not  display  |  Displays  the  knowledge/  |  Displays  the 
I  the  knowledge/skill  |  skill  required  to  perform  j knowledge/skill  to 
I  required  to  perform  |most  job  assignments  and  j  perform  all  job 

|many  job  assignments | tasks  properly,  but  may  j  assignments  and 

I  and  tasks.  j need  help  for  harder  tasks  j  tasks  properly. 

I _ I _ I _ 

11234567 
21234567 
31234567 
41234567 
51234567 
61234567 
71234567 
81234567 
91  2  3  4  5  6  7 

10  1234567 

11  1234567 

12  1234567 

13  1  2  34  56  7 

14  1  2  34  56  7 

15  1  2  34  56  7 
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EFFORT ; 

How  effective  is  each  operator  in  showing  extra  effort  on  the  job? 


I  Does  not  put  in  the |  Puts  in  the  extra  effort  |Often  volunteers  to 
I  effort  to  make  sure  | and  keeps  trying  when  it's  j  work  extra  hours; 

I  the  job  gets  done;  |very  important  to  complete  |  pushes  on  to 

I  may  give  up  easily  |  assignments;  overcomes  |  overcome  all 

I  when  faced  with  |  obstacles/adversities  on  |  difficulties  and 

Idifficult  problems  | the  job,  in  garrison,  and  |  adversities  until 

I  or  situations.  |  in  the  field.  |  the  job  is  done. 

I _ I _ I _ 

11234567 

21234567 

31234567 

41234567 

51234567 

61234567 

71234567 

81234567 

91234567 

10  1234567 

11  1234567 

12  1234567 

13  1  2  3  4  5  6  7 

14  1234567 

15  1234567 


7 
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FOLLOWING  REGULATIONS  AND  ORDERS: 

How  effective  is  each  operator  in  adhering  to  regulations,  orders, 
and  SOP  and  displaying  respect  for  superiors? 


1  Often  fails  to 

1  follow  Army /unit 

1  rules,  regulations, 

1  or  orders;  may 

1  show  disrespect 

1  toward  superiors. 

1 

1.  . . . . .  .. 

1  Almost  always  follows 

1  Army/unit  rules  and 

1  regulations;  always  obeys 

1  orders. 

j  Carefully  follows  | 

1  the  spirit  and  | 

[letter  of  Army/unit | 

1  rules  and  | 

[regulations;  obeys  [ 
[orders  quickly  and  j 

1  with  enthusiasm.  | 

1  1 

1 

1 

2 

3 

4 

5 

6 

7 

2 

1 

2 

3 

4 

5 

6 

7 

3 

1 

2 

3 

4 

5 

6 

7 

4 

1 

2 

3 

4 

5 

6 

7 

5 

1 

2 

3 

4 

5 

6 

7 

6 

1 

2 

3 

4 

5 

6 

7 

7 

1 

2 

3 

4 

5 

6 

7 

8 

1 

2 

3 

4 

5 

6 

7 

9 

1 

2 

3 

4 

5 

6 

7 

10 

1 

2 

3 

4 

5 

6 

7 

11 

1 

2 

3 

4 

5 

6 

7 

12 

1 

2 

3 

4 

5 

6 

7 

13 

1 

2 

3 

4 

5 

6 

7 

14 

1 

2 

3 

4 

5 

6 

7 

15 

1 

2 

3 

4 

5 

6 

7 
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INTEGRITY: 

How  effective  is  each  operator  in  displaying  honesty  and  integrity  in 
job-related  and  personal  matters? 


Makes  up  excuses  to | 
avoid  duty/  | 

assignments;  fails  | 
to  take  responsibi 1  -  I 
ity  for  any  job-  | 
related  mistakes ;may | 
be  untruthful  about  | 
job  or  personal  | 
matters.  i 


Admits  and  takes 
responibility  for  most 
job-related  mistakes 
he/she  makes;  is  truthful 
questioned  about  job  or 
personal  matters. 


Takes  extra  steps 
to  ensure  that 
others  are  not 
blamed  for  his/her 
mistakes;  is  always 
honest,  even  when 
it  may  go  against 
personal  interests. 


11234567 

21234567 

31234567 

41234567 

51234567 

61234567 

71234567 

81234567 

91234567 

10  1234567 

11  1234567 

12  1  2  3  4  567 

13  1234567 

14  1  2  3  4  567 

15  1234567 
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LEADERSHIP: 

How  effective  is  each  operator  in  performing  in  a  leader  role,  as  required. 


and  providing  guidance 


!  Fail  to  take  charge 
I  when  leadership  is 
I  required  in  unit; 

I  provides  no  guidance 
j  to  other  unit 
I  members  on  tasks, 

I  assignments,  etc.,  | 
I  even  when  it's  | 
[necessary  to  do  so.  | 


for  fellow  unit  members? 


Performs  well  in  leader¬ 
ship  situations  where 
expected  is  well  known; 
when  asked,  guides  others 
through  some  tasks, 
assignments,  etc. 


I  Takes  charge  when  | 
I  necessary  to  lead  | 
1  the  unit;  fills  in  | 
1  effectively  when  1 
I  NCO  is  absent  by  | 
[skillfully  leading  j 
[unit,  guiding  unit  | 
I  members  through  | 
j  tasks  or  | 
I  assignments,  etc.  | 


11234567 
21234567 
31  2  3  4  5  6  7 

41234567 
51234567 
61234567 
71234567 
81234567 
91234567 

10  1  2  34  56  7 

11  1234567 

12  1  2  34  56  7 

13  1234567 

14  1234567 

15  1234567 
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MAINTAINING  ASSIGNED  EQUIPMENT: 

How  effective  is  each  operator  in  checking  on  and  maintaining  own 
weapon/vehicle/other  equipment? 


Keeps  assigned 
equipment  in  poor 


Keeps  assigned  equipment 
in  good  condition  by 


condition  by  failingl  performing  routine  checks 


to  perform  or 
improperly 
performing  checks 
and  preventive 
maintenance . 


and  preventive  maintenance; 
notes  and  corrects  major 
deficiencies . 


Keeps  assigned 
equipment  in  ready- 
f or  -  inspection 
condition  by 
performing 
appropriate  checks 
and  preventive 
maintenance,  noting 
and  correcting  all 
deficiencies . 


11  2  34  567 

21  2  34  567 

31234567 
41234567 
51  2  34  567 

61  2  34  567 

71  2  34  567 

8  1  2  3  4  567 

91234567 

10  1  2  34  567 

11  1  2  34  567 

12  1  2  3  4  5  6  7 

13  1  2  34  567 

14  1234567 

15  1  2  3  4  5  6  7 
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SELF  - DEVELOPMENT : 

How  effective  is  each  operator  in  developing  own  job  skills? 


1  Does  not  try  to 

1  improve  job  skills 

1  by  studing, 

1  practicing,  or 

1  participating  in 

1  courses  or  training. 

1 

1 

1 

1 

Practices,  studies 
manuals,  or  participates 
in  courses/training  to 
improve  job  skills  as 
required . 

1  Studies,  works  | 

1  hard  during  | 

1  off-duty  time,  | 

1  seeks  out  education | 

1  or  training,  or  | 

1  additional  job  | 

1 duties/responsibil - | 

1  ities  to  improve  | 
Ijob  skills  as  much  | 

1  as  possible.  j 

1 

1 

2 

3 

4 

5 

6 

7 

2 

1 

2 

3 

4 

5 

6 

7 

3 

1 

2 

3 

4 

5 

6 

7 

4 

1 

2 

3 

4 

5 

6 

7 

5 

1 

2 

3 

4 

5 

6 

7 

6 

1 

2 

3 

4 

5 

6 

7 

7 

1 

2 

3 

4 

5 

6 

7 

8 

1 

2 

3 

4 

5 

6 

7 

9 

1 

2 

3 

4 

5 

6 

7 

10 

1 

2 

3 

4 

5 

6 

7 

11 

1 

2 

3 

4 

5 

6 

7 

12 

1 

2 

3 

4 

5 

6 

7 

13 

1 

2 

3 

4 

5 

6 

7 

14 

1 

2 

3 

4 

5 

6 

7 

15 

1 

2 

3 

4 

5 

6 

7 
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SELF-CONTROL: 

How  effective  is  each  operator  in  controlling  own  behavior  related  to 
aggresive  acts? 


Often  cannot 
control  own 
behavior;  loses 
temper  easily. 


Keeps  even  temper  in 
most  situations. 


Always  keeps  a 
cool  head  and 
avoids  aggressive 
acts . 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 


5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 


6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 


7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 


Page  9 


ATTENDANCE : 

How  effective  is  each  operator  at  reporting  to  the  job  on  time  and 
performing  attentively? 


Is  often  late 
for  "skeds";  makes 
frequent  trips 
to  the  latrine; 
sometimes  "sleeps" 
on  the  job. 


Is  usually  on  time  for 
"skeds";  rarely  "sleeps" 
on  the  job;  infrequently 
schedules  medical 
appointments  during 
duty  hours. 


Is  always  on  time 
for  "skeds"  and 
rarely  absent  for 
medical  reasons; 
always  attentive 
on  the  job. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 


5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 


6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 


7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 
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ADMINISTRATIVE  DUTIES: 

How  effective  is  each  operator  at  completing  forms  and  logs,  and  writing 
reports? 


Often  intercept  |  Completes  intercept  forms  j  Promptly  completes  j 
forms  and  logs,  and  |  and  logs,  and  reports  |  intercept  forms  and | 

written  reports  |  with  few  errors;  helps  j  logs,  and  reports  j 

need  to  be  altered  |  in  facilitating  follow-up  j  without  errors;  j 
by  a  supervisor;  j  processing  and  analysis,  j  often  initiates  the | 

doesn't  facilitate  j  |  recording  of  data  | 

follow-up  processing!  jentries  facilitating! 

and  analysis.  !  j follow-up  processing! 

!  !  and  analysis.  j 


11234567 
21234567 
31234567 
41234567 
51  2  34  567 

61234567 
71234567 
81234567 
91  2  34  567 

10  1234567 

11  1234567 

12  1  2  34  56  7 

13  1234567 

14  1234567 

15  1234567 
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DATA  ANALYSIS: 

How  effective  is  each  operator  in  performing  analysis? 


Completes  collector 
analysis  efficiently 
always  noticing  and 
promptly  reporting 
suspect  items  of 
intelligence 
interest;  rarely 
makes  a  computer 
generated  error. 


Often  fails  to 
notice  irregularities 
of  interest  in  per¬ 
forming  the  collector 
analysis;  makes  many 
computer  generated 
errors  that  can  be 
attributed  to  the 
operator . 


I  Performs  collector 

I  analysis  adequately, 

I  often  noticing  suspect 
I  items  of  intelligence 
I  interest;  makes  few 

I  computer  generated  errors 
I  that  can  be  attributed 
I  to  the  operator. 
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OPERATIONS: 

How  effective  is  each  operator  in  performing  job  operations  duties? 
# ' s????? 


Often  displays  |  Almost  always  displays  |Maintains  excellent! 
borderline  (poor)  j average/good  performance  inj  performance  in  j 
performance  j  detecting,  acquiring,  j detecting , acqui ring j 

standards  for  j  identifying,  and  recording!  identifying,  and  ! 

detecting,  acquiring!  foreign  communications.  |  recording  foreign  ! 


1  identifying,  and  ! 

1  recording  foreign  ! 

1  communications.  ! 

1  1 

!  communications; 

!  seems  to  have  a 

1  natural  "talent" 

1 

1 

2 

3 

4 

5 

6 

7 

2 

1 

2 

3 

4 

5 

6 

7 

3 

1 

2 

3 

4 

5 

6 

7 

4 

1 

2 

3 

4 

5 

6 

7 

5 

1 

2 

3 

4 

5 

6 

7 

6 

1 

2 

3 

4 

5 

6 

7 

7 

1 

2 

3 

4 

5 

6 

7 

8 

1 

2 

3 

4 

5 

6 

7 

9 

1 

2 

3 

4 

5 

6 

7 

10 

1 

2 

3 

4 

5 

6 

7 

11 

1 

2 

3 

4 

5 

6 

7 

12 

1 

2 

3 

4 

5 

6 

7 

13 

1 

2 

3 

4 

5 

6 

7 

14 

1 

2 

3 

4 

5 

6 

7 

15 

1 

2 

3 

4 

5 

6 

7 
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OVERALL  EFFECTIVENESS  RANKINGS: 


Please  rank  order  all  of 
(with  1  representing  the 
considering  the  above  12 


your  operators  from  highest  to  lowest 

highest  ranking)  on  their  overall  effectiveness, 

dimensions . 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 


15 
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OVERALL  EFFECTIVENESS  RATINGS: 

How  does  each  of  your  operators  individually  rate  on  overall  effectiveness, 
considering  the  above  12  dimensions? 


Performs  poorly  in  |  Adequately  performs  in  |  Performs 

important  effective- |  important  effectiveness  |  excellently  in  all 
ness  areas;  does  not |  areas;  meets  standards  and |  or  almost  all 
meet  standards  and  |  expectations  for  adequate  j effectiveness  areas 
expectations  for  j  performance.  |  -exceeds  standards 

adequate  performance!  j  and  expectations 

I  I  for  performance. 
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CONFIDENCE  RATING: 

For  each  operator,  please  indicate  how  confident  you  are  with  the 
effectiveness  ratings  that  you  just  completed? 


not  at  all 
confident 


moderately 

confident 


very 

confident 
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Problem  Area 


Due  to  technological  advances,  the  complexity  of  the  modern  battle¬ 
field  has  grown  enormously;  and  the  amount  of  information,  both  obtainable 
and  necessary  to  be  dealt  with,  has  expanded  incredibly.  Supporting  dis¬ 
plays,  suitable  for  battlefield  situation  awareness  and  decision  making, 
are  now  needed  for  effectively  utilizing  this  Increase  in  available  infor¬ 
mation.  However,  because  of  workspace  limitation,  computer  supported 
tactical  displays  have  been  designed  to  subtend  a  small  visual  angle;  and 
when  viewed  at  optimum  distance,  they  present  a  relatively  limited  number 
of  visually  resolvable  symbols  and  data.  This  often  requires  a  sequential 
call-up  of  additionally  wanted  data,  and  taxes  the  user's  memory  when 
integration  of  non-simul taneously  presented  information  is  necessary. 

Hence  as  a  further  aid,  some  of  the  information  is  compressed  into  complex 
symbolic  graphics  which  overlay  the  basic  display;  but  these  can  clutter 
such  a  display  and  even  obliterate  or  interfere  with  the  legibility  of  the 
background  presentation.  A  display  configuration  is  required  which  per¬ 
mits  a  more  natural  human  acquisition  and  processing  of  information,  so 
there  be  more  rapid  situation  understanding  and  decision  making  even  in  a 
high  information-density  environment.  Other  concerns  with  automated  bat¬ 
tlefield  management  are  the  retention  of  planning  flexibility  for  the 
commander,  and  the  enabling  of  a  graceful  degradation  of  operations  when 
there  is  loss  of  Information  inputs  from  sources  or  from  higher  headquar¬ 
ters.  To  overcome  these  problems,  a  display  interface  is  wanted  which  can 
properly  present  the  volume  of  information,  and  has  the  flexibility  to 
conform  to  each  commander’s  strengths,  limitations  and  changing  needs  in 
his  acquisition  and  use  of  information.  Then  given  the  display  Interface, 
research  is  needed  to  determine  the  content,  presentation,  and  interactive 
modes  required  for  better  supporting  the  commander  in  his  undertakings. 

Previously,  the  tactical  commander  had  been  presented  with  wall- 
mounted  detailed  maps  that  were  overlayed  with  clear  plastic  sheets  which 
could  be  marked  (in  grease  pencil)  with  the  plans  for  troop  movement, 
enemy  engagement,  etc.  The  commander’s  decisions  were  based  also  on  addi¬ 
tional  summary  inputs,  presented  to  him  in  oral  briefings  and  in  hard  copy 
prepared  by  his  staff,  regarding  such  aspects  as  enemy  intelligence,  troop 
and  equipment  readiness,  available  combat  support,  available  logistic 
support,  weather,  etc.  Now,  the  relatively  spacious  work  environment  and 
easy  opportunity  for  staff  Interaction  disappears  if  the  commander  is  to 
operate  from  computer  supported  tactical  displays  mounted  in  a  mobile 
combat  vehicle.  One  cannot  put  a  war  room  into  a  space-limited  tank,  or 
can  one?  Is  there  a  way  to  Incorporate  the  best  features  of  the  old  into 
the  new  tactical  display  Interface? 


V 


Purpose  of  Paper 

There  Is  ueed  for  developing  a  generic  tactical  display  Interface 
which  will  help  overcome  the  problems  raised  in  the  previous  section. 

This  interface  should  have  applicability  to  different  levels  of  command 
and  various  workstation  environments.  It  Is  the  direct  purpose  of  this 
paper  to  discuss  the  design  of  a  test-bed  representing  a  prototype  of  a 
high  Information-density  display  system  that  Is  feasible  In  a  small  space 
working  environment.  The  test  bed  would  permit  making  empirical  compari¬ 
sons  and  evaluations.  In  the  present  time-frame,  of  display  alternatives 
that  could  be  available  and/or  needed  In  near-future  automated  battlefield 
management  systems. 

Design  Approach 

The  designers  of  battlefield  management  systems  that  were  to  be 
mounted  In  combat  vehicles  had  to  restrict  themselves  to  electronic  infor¬ 
mation  displays  which  occupy  a  modest  amount  of  physical  space.  A  common 
solution  was  to  limit  themselves  to  one  or  at  most  two  displays,  each 
having  a  resolution  of  about  500  x  500  picture  elements  (pixels).  Because 
of  the  approach  selected,  the  user  is  now  forced  to  operate  in  an  unfamil¬ 
iar  mode  and  in  a  manner  which  may  not  be  optimum  for  human  decision  mak¬ 
ing.  The  amount  of  information  to  be  presented  at  one  time  should  really 
have  been  governed  by  such  factors  as  comprehension  rate,  display  access 
time,  and  the  nature  of  human  perception.  If  an  observer  is  to  respond 
quickly  to  new  information,  he  does  not  have  the  time  to  comprehend  dense 
informational  detail.  Also,  if  the  display  presents  large  amounts  of 
rapidly  changing  overlay  data,  there  may  be  further  difficulty  in  compre¬ 
hension.  However,  if  the  observer  is  permitted  to  view  at  will  the  as¬ 
pects  of  interest  to  him  on  a  visually  expanded  and  hence  less  cluttered 
display,  rather  than  being  forced  to  sequentially  request  ( in  a  confined 
window)  the  various  data  of  interest,  he  can  quickly  concentrate  on  what 
is  of  concern  now,  and  merely  look  elsewhere  at  a  later  time  for  what  may 
be  of  concern  then.  This  is  a  mode  in  which  a  human  being  has  had  exten¬ 
sive  experience  and  can  operate  effectively.  Thus  using  a  design  approach 
In  which  a  large  quantity  of  resolvable  display  Information  (suitably 
processed,  condensed,  and  highlighted  when  so  needed)  Is  presented  simulta¬ 
neously  on  a  number  of  contiguous  screens,  the  observer  can  access  differ¬ 
ent  aspects  of  this  information  just  by  directing  his  attention  to  the 
appropriate  sub-display  area.  Eye  movement  and  head  movement  are 
extremely  rapid  motor  responses  which  the  observer  can  use  as  frequently 
as  needed  to  obtain.  In  a  non-dl sruptlve  manner,  the  Information  wanted  for 
making  comparisons  and  for  augmenting  the  fundamental  Information  on  which 
be  is  basing  his  decisions. 

Proposed  Configuration 

Simultaneous  presentation  of  a  number  of  standard-sized  electronic 
displays  is  readily  possible  if  the  work  area  in  which  they  are  being 
shown  is  physically  large  enough  to  contain  them.  How  large  does  this 
have  to  be  for  the  human  viewer?  Regarding  the  eye,  angular  subtense  of 
the  display  is  what  matters  and  not  just  its  physical  size.  A  3-incb 
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display  viewed  at  3  inches  (with  optical  aiding)  is  equivalent  to  a 
19-lnch  display  viewed  at  19  Inches,  and  to  a  10-foot  display  viewed  at  10 
feet.  Each  subtends  an  identical  visual  angle  of  approximately  53  degrees. 


The  average  observer,  with  spectacle  correction  if  needed,  has  about 
20/20  Snellen  visual  acuity  (l.e.,  his  eye  can  resolve  1  arc  minute).  Let 
us  assume,  however,  that  our  observer  has  slightly  poorer  visual  acuity 
(e.g.,  he  has  a  Snellen  visual  acuity  of  20/30  and  thus  can  visually  re¬ 
solve  only  1.5  arc  minutes).  For  a  display  subtending  120  degrees,  such 
an  observer  could  visually  resolve  about  4800  TV  lines.  That  is  to  say 
this  observer  could  adequately  resolve  all  the  details  shown  on  eight 
CRT’s  placedslde-by-slde  if  each  presented  600  resolvable  picture  elements 
on  each  of  its  horizontal  raster  lines.  Thus  if  the  displays  generated  by 
these  eight  CRT’s  were  each  30  Inches  wide  and  placed  on  a  circular  arc 
having  a  9.55-foot  radius  of  curvature,  they  would  subtend  about  120  de¬ 
grees  at  the  center  of  this  radius  of  curvature.  Similarly,  for  eight 
contiguous  images  each  subtending  one  inch,  the  subtense  of  the  circular 
arc  on  which  they  are  placed  would  now  be  about  120  degrees  If  viewing 
distance  were  3.8  inches.  While  such  viewing  can  be  easily  accomplished 
with  the  aid  of  a  +10.37  diopter  eyepiece,  the  instantaneous  field  of  view 
provided  by  an  optical  eyepiece  is  not  likely  to  be  greater  than  about  50 
degrees.  This  constraint  can  be  overcome  by  dividing  the  120-degree  dis¬ 
play  into  three  sections  each  subtending  40  degrees.  Viewing  would  be 
through  an  optical  system  in  which  multiple  exit  pupils  are  overlapped  at 
the  center  of  rotation  of  the  viewing  eye.  One  way  to  build  such  a  dis¬ 
play  Interface  at  the  present  time,  is  to  use  matrices  of  1-lnch  CRT’s 
such  as  Litton’s  L-4272  miniature  cathode  ray  tube.  These  CRT’s  can  each 
provide  a  rectangular  image  of  0.60”  x  0.45”  (for  a  3  by  4  aspect  ratio). 

A  relay  lens  can  then  expand  each  image  to  1.33”  x  1.00”  and,  with  appro¬ 

priate  mounting  and  baffling,  contiguous  images  could  be  obtained  for  the 
units  comprising  a  matrix.  A  segmented  field  lens  placed  in  the  image 
plane  would  then  direct  the  light  rays  through  the  eyepiece  to  form  a 
common  exit  pupil  region  for  all  CRT  displays  in  the  matrix  (see  Figure 
1).  Eye  relief  could  be  designed  to  be  three  Inches.  The  separate  sec¬ 
tions,  each  comprised  of  a  matrix  of  CRT’s,  could  now  be  mounted  so  their 

eyepieces  were  contiguous  and  their  exit  pupils  also  overlapped.  If  color 
displays  were  desired,  a  field-sequential  color  system  could  be  employed, 
utilizing  the  liquid-crystal  shutter  technology  that  is  being  developed  by 
Tektronix. 

A  three  section  display  as  described  above,  and  using  folded  optics, 
could  be  designed  to  occupy  less  than  one  cubic  foot  of  volume.  Hence 
such  a  display  could  be  mounted  in  a  tank  or  even  on  a  jeep.  The  upcoming 
technology  In  miniaturized,  hlgh-resolutlon ,  flat  color  displays  should 
permit  an  even  simpler  Interface  for  multiple-screen  displays  in  the 
future. 

Research  Plan  Concept 


An  initial  concern  is  the  establishment  of  the  design  requirements 
for  miniaturized  multiple  screen  displays.  A  follow-on  concern  is  the 
determination  of  what  should  be  the  content,  format,  and  Interactive  capa- 
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bill  ties  appropriate  for  commanders  In  various  echelons  carrying  out 
alternative  missions  and  operating  in  different  environmental  situations.  A 
suitable  test-bed  capable  of  being  used  both  In  the  laboratory  and  in 
field  exercises  could  be  developed  to  aid  In  addressing  the  initial  con¬ 
cern.  Following  this,  a  determination  of  the  roost  suitable  display  con¬ 
tent  for  selected  military  environments  and  scenarios  could  be  made,  using 
appropriate  field  trials. 

An  illustrative  multiple-screen  layout  is  shown  in  Figure  2.  It  is 
comprised  of  three  sections.  One  presents  the  kind  of  information  needed 
and  organized  for  conducting  tactical  operations.  Another  provides  real¬ 
time  information  obtained  directly  from  battlefield  sensors.  The  third 
presents  related  stored  imagery,  as  would  be  obtained  from  earlier  over¬ 
flights  by  airborne  and/or  space  vehicles.  The  first  two  have  matrices  of 
four  CRT's;  the  third  has  a  matrix  of  nine  CRT's.  Thus  the  total  display 
is  comprised  of  17  CRT's.  The  commander  interfaces  interactively  with 
these  displays  through  such  control  devices  as  a  trackball,  a  small  digi¬ 
tizing  pad,  and/or  function  keys;  and  such  aspects  as  cursor  positioning, 
for  example,  would  be  accomplished  through  direct  visual  feedback  of 
cursor  location  on  the  display. 

In  the  Figure  2  illustration,  each  section  subtends  40  degrees  hori¬ 
zontally  by  30  degrees  vertically;  but  instead  of  the  three  sections  being 
on  a  horizontal  line,  one  is  placed  to  the  right  of  the  central  section, 
and  the  other  is  placed  above  it.  Display  content  is  meant  to  be  illus¬ 
trative  only.  Its  specific  nature  should  be  developed  through  in-depth 
interviews  with  potential  military  users,  and  then  evaluated  in  opera¬ 
tional  field  tests,  using  an  already  developed  display  test-bed  and  associ¬ 
ated  supporting  systems,  hardware  and  software.  It  is  the  purpose  of  this 
paper  to  encourage  initiation  of  activities  leading  to  the  development  and 
use  of  such  a  display  test-bed. 
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STORED  IMAGERY  DISPLAY 


TACTICAL  OPERATIONS  DISPLAY  REAL-TIME  DISPLAY 


Figure  2 

A  Concept  for  a  Display  Interface  for  the  Battlefield  Comniander 


The  total  display  is  comprised  of  three  sections,  each  subtending  40^ 
horizontally  and  30®  vertically.  The  presented  displays  are  meant  to  be 
illustrative  only.  The  upper  left  section  presents  previously  obtained 
reconnaissance  imagery  of  an  area  of  interest,  selected  by  the  commander, 
plus  the  surrounding  eight  neighooring  images.  These  scenes  have  a  25% 
overlap.  The  lower  left  section  is  concerned  with  tactical  operations. 
Starting  at  the  upper  left  and  going  clockwise:  the  first  sub-display 
provides  input  to  the  commander,  using  maps  and  graphics  to  give  him  proc¬ 
essed  combat  information;  the  second  is  commander  generated,  also  uses 
maps  and  graphics,  and  concentrates  on  the  commander's  sector  of  responsi¬ 
bility;  the  third  lists  the  status  of  equipment  and  personnel;  and  the 
fourth  presents  incoming  and  outgoing  orders.  The  lower  right  section 
presents  real-time  sensor  information.  Starting  at  the  upper  left  and 
going  clockwise:  the  first  sub-display  shows  live  video  of  his  sector  of 
responsibility  and  outlines  a  portion  of  the  scene  which  he  selects  to 
view  in  magnification  on  the  second  sub-display;  the  third  shows  corre¬ 
lated  thermsl/IR  imagery;  and  the  fourth  presents  a  correlated  radar  dis¬ 
play. 
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Introduction"* 

ZtZt  (joint  sotvoillonc.  I.tJ.t  »tt.ol.  H.d.t  S,.t..)  t.chnolo,y 
«u.  .0.0  .ooviiLoc.  »in  0.  aopioyn  m  to.  i«o-«  ti........ 

„i.  n..  ..n..r  ..pobiitty  ptovia..  .  ..t.  .t=ot.»  Pittot.  «,  .ovio,  ooa 
tixoa  t..,.ts  -i.h  .obontoa  .ovio,  torpot  ioaic.toy  («T.,.  <lx.a  ftp., 
inaic.tot  (fTl),  «na  SAP  (syoth.tio  .p.ttor.  t.a.t)  capability. 
tachoolopla.  vill  c.ncoo.ltan.ly  plac.  ».«  a...na.  on  MI  (Silitaty  n 

qence)  personnel. 

ooaatio..  ban.  ba.n  ,.i..a  by  th.  TSS-JSTAPS  t.patain,  tb.  apptoptiat. 
»t.y  ct.»  eo.po.itlo„  ana  ms-akill  l.v.l  for  tb.  JSTA.S  al.c.It.  At  isao. 
at.  tb.  foUo.in,i  (1.  sow  a.  tb.  p.opoa.a  ..,nl....nts  for  tb.  o  a  c 
lopatatlona  ana  control)  conaol.  operator  .atcb  tb.  .kill,  of  t  . 

„6H,  pan,  PfB,  prol.ct.a  for  thi.  fnnetion  t  Hb.t  l.v.l  of  ..nlor.t,  .a 
..,ol.,a  f  (1)  in  .aaitlon  to  an  0-3  or  0-4  l.v.l  b.pnty  siaaion  Cr.w 
c....na.r  to  r.p..a.nt  th.  Ar.y  p...p.ctiv.  ana  a.conflict  .raaion  aarvic. 
r.,o.ata,  la  a  warrant  offic.r  ,«1,  or  a.nior  SCO  (Pf  a.ri..)  fP-iitn^ 
for  supervisory  functions  and  technical  expertise  7 

The  following  report  describes  the  AHl  analysis  effort  to  provide 

input  to  the  two  issues  above. 


Approach 

The  objective  of  the  ABI  analysis  was  to  provide  a  database  for  use 
fn  estimating  parameters  such  as  tas.  complexity,  training  demands,  and  other 
task  qualifications  in  order  to  develop  recommendations  for  the  «0S  w  rc 
can  best  meet  the  aSTAKS  Army  aircrew  requirements.  The  approach  taken 

consisted  of  several  steps; 

(1)  Derive  Army  operator  tasks  proposed  for  the  aSTARS  aircrew; 
Develop  basic  JSTARS  gob  flow 

(2)  Convert  tasks  to  functions 

,3,  ....kcut  functicn.  Into  bn..n  p.cfor..n=.  .l.n.nt.  n.in,  p.n.clc 
table 

(41  A.....  copnitlw.  a...nc.  lor  ..cb  fnnetion 
,5,  D...10P  co.p.ri.on  f t.U  of  t.sk.  to  «0S  c.p.bllitl.s  nnC 
skill  levels 


(6)  Derive  tradeoffs 
Each  step  is  described  below. 

Op.r.tor  for  th.  JSTt.S  Ai.c... 

»r.y  functions  in  th,  USTAhS  .i.or.tt  involv.O 

Intetvieus  with  SBE's  Isobjoct  m,tt,t  etpettsi 
eight  document  reviews  and  nine  intervie 

The  documents  reviewed  were: 

■  EEOC  Uoint  E,st..  Op.t.t.on.l  Cono.pt, 

„E  At.,,  hit /hto,  contihu.  P.v,lop..nt  of  uo.nt  Et.r., 

spoo.  Kohoolopy.  5  "hy 

Eoldiets  to  Join  JSTAAS  Tt.cliing  Crows  Alof  ,  y 

joint  ETAAE  OrouhO  Et.tlon  Boaui.  Erooh.r.,  BotoroU  S»„yi.ES-A.  oot  lE.S 

P0t.ntl.l  ATOC  SIBEACB/Joint  ETA.E  Iht.gr.tlon,  h.td  oopy 
K,L.  Leonard,  HITBE  Corp. 


0  s  c  consol.  Systo.  pru...n  B.lbourn. 

rptrllt^rSIylKorof  cr».n.n  corpo..tlon 
yr.lnln,  ooors,  ..cu.nc.  for  JETA.E  CEB,  h.rd  oopy  hri.fs, 
ment,  USAICS-DSSM 

subject  matter  experts  interviewed  were: 

„ej  Acker,  «aj  Tuttle.  CPT  Drain  -  TSM  JSTARS 

i-v  C  JSTARS  GSM  training  facility,  USAICS-DSSM 
r'lr.lrly.  CPT  host,  CPT  pro.,.,  CPT  Cons-  UEAiCE-CO  Port,  o.slgn  Er.nth 

Bt.  Elliott,  CW  1  .orgooh  -  OEAICE-CP  Bit  Al .  Bt.hCh 
«r.  John  Bloofioia.  hr.  To.  P.tk.t  -  Hon.yw.ll 
Mr.  Cliff  Miller  -  MITRE/PM  JSTARS 
src  Tilford  -  USAICS-DOTD  New  Systems 
Ltc  Fusco  -  Chief,  USAICS-DSSM 

Maj  Huff  -  MILPERCEN  determined 

Based  on  the  readings  and  extensive  discussions  wi  p 

the  the  Army  crew  will  consist  of  "two  to  five  Army  personnel  on 
aircraft,  with  two  to  three  per  eight  hour  shift"  ( JSOC-JSTARS^.  This 
to  three  man  crew  will  consist  of  a  Deputy  Mission  Crew  Commander, 

an  Army  radar  system  manager/operator ( s) . 

The  deputy  mission  crew  commander  is  projected  to  be  an 


\  This  individual  is  charged  with  the 

35C  SSI  (Special  Skill  Identifier). 

.0.  .0  M,  .c.  ... 

.„on,Uctin,  r....  ..o*  ^-un.  oo...n...s  ..  =3  ■ 

.up.r»i-V  <unc.ion.  .o,  ...V  P.— '■ 

,pp  .......  • 

P„J.ct.a  ,p.r  ...tin,  With  PK  a3T.PS/.iTPE,  ina.c.t. 

ti..  lin.  a...  not  co.pro.l..  »t.,  n..a..  Th.  n.t  t.snit  i.  tn.t 

time  will  be  available  to  monitor  routine  matters  engage  in 

system  operators,  and  supervisory  availability  there  will  be  minimal. 

The  radar  system  manager,  or  0  s  C  console  operator,  have  been 
sssigned  a  number  of  functions  related  to  the  operation  of  the  0  s  C  console,^ 
management  of  the  radar  time  line,  tracking  and  reporting  of  J 

ance  of  computer  data  files,  and  preparation  and  dissemination  of  P 
extent  to  which  duties  are  designated  to  be  performed  by  these  in 
.pp....  no  v.np  .=cor.in,  to  tn,  int.tpt.t.tion  ,t  th.  a.t.  ,.th,.. 

.LiPoit.  on.  ot  th,  con..,o.nc..  0.  th.  a.t.  p.th.tin,  ,ot  «>-» 

.„,ct.a  .  t..tin,  to  th.  USMC,-CP  to  ptovia.  tin,.  a.t.U  tn  th. 
sp.cl£it.tion  o.  op,r,to,  function.l  ..,ul....nt,  tot  th,  At.y  ... 

This  «in  b.  a,.tt.a  .t  .  l.t..  a.t,  ..  .n  .nn.«  to  th.  0.0  pl.n. 

,  cohpt.h.n.iv.  ii.t  .£  op...to.  t..t.  a..iv.a  t.o.  th.  .nnlvti.  is  -n 

Th.  t.bl,  inaict..  n.tu..l  s.ovpln,.  of  t.sks.  T.sk.  1-, 

concn  T-0  op,.,tion.  of  th.  0  .  C  oonsoi.  .cto.ain,  to  sp.tific  ..a,. 

...Vic.  ..,u..t..  T..KS  e-U  involv.  th.  ht.V  ..a.t  ..h.,...ht 

,  •  1  r.nuests'  Tasks  14-19  encompass  situation  assessment 

processing  of  multiple  requests.  Tasks 

„.ih,  via.  ....  ....ch  ..a  coiLtioh  Of  hTi/PTi  a.t.  to  ci.ts.fy  t.  ,  . 

a.v.lop  ..l.tlo„.hip.,  ..a  a...  l»f...hC..  .hoot  .n,.y  l.t.„tun.  -ith.n  . 
...to.  o.  .uh-...to..  Plh.ny  t..l..  20-2,  .n,.,.  th.  op.t.to.  .»  t  . 

..p.ct.  of  .tt.cK  pl.nhlh,.  ,h  .aaitlon  to  th.  p..fo...no.  o 


preliminary 


Tablf  !•  Army  Aircraft  Tasks  Using  OrC  Consolf  (Aircraft) 

l.  ORC  consolf  T-n  OPFRATIONS  AND  MAINTENANCE 

?.  Identify  requested  targets  from  ground  level  service  rfouests 
3.  Search  and  track  specific  target 

Report  targets  and  target  parameters  (location^  length,  speed) 

5.  Predict  future  MTI  locations  using  F  track  processing 

6.  Maintain  computer  data  file 

7.  Fnter  FTT/SAR  requests  to  radar  system 
R.  Monitor  radar  request  time  line 

0.  Accept  and  process  radar  status  messages 

m.  Inform  operators  of  peouest  statuses 

n.  Compare  service  requests  to  radar  timeline  status 

I?.  Consolidate  service  peqiiests  for  efficient  system  tasking 

13.  Fstarlish  and  delete  specific  radar  coverage  areas  to  be  searched 

1A.  Select  and  view  current  radar  data  by  type  and  geographic  area 

15.  Identify  specific  non-reouestfd  targets  of  importancf 

15.  Review  historical  radar  data  using  activity  indicators,  ground 

CLUTTER  MAP,  TARGET  CLASSIFICATIONS  FROM  PREVIOUS  FTI  AND  MT I 
DETECTION  REPORTS,  ETC. 

]7.  Monitor  radar  patterns  and  relationships 

18.  Classify  targets  of  interest 

IQ.  Predict  enemy  intentions  using  classifications 

?n.  Nominate  and  designate  targets  for  attack  using  A  track  processing 

71 .  Track  targets 

77.  Designate  attack  planning  areas  and  engagement  points 
73.  Fstablish  and  delete  attack  planning  areas  to  be  searched 


these  tasks,  all  crew  nembers  must  be  aviation  qualified.  High  level  job 
flow  diagrams  are  presented  in  Figure  1.  These  show  two  c  screte  roles 
identified  by  task  clusters,  and  list  pertinent  observations  for  each. 

For  example,  the  first  seven  tasks  are  represented  in  the  top  diagram  of 
the  figure.  These  are  equipment  oriented,  procedural  tasks  requiring 
perception  of  signals  and  psychomotor  activity.  Performance  of  these  tasks 
requires  system  specific  knowledge  of  the  equipment  at  operational  and 

minimal  maintenance  levels.  Diagrams  below  this  indie-  a  mor.e> cognitively 
demanding  set  of  tasks,  which  involve  decision  making  and  judgement,  as  well 
as  the  need  for  guidance  and  tasking  from  higher  authority.  The  tasks  also 
require  the  integration  of  background  knowledge,  expertise  and  experience. 

Tasks  related  to  targeting  (at  the  bottom  of  the  diagram)  could  be  considered 
an  entirely  separate  function  and  would  involve  coordination  with  weaponeering 
elements  of  DIVARTY  or  the  Air  Force.  The  task  list  a:  -  flow  diagrams 

clearly  show  a  break  into  two  discrete  functions,  poss:  nree. 

Convert  tasks  to  functions 

While  the  job  tasks  and  flow  diagrams  indicate  discrete  operator 
roles,  the  task  descriptors  are  too  system  specific  to  r-'ate  directly  to 
functional  qualifications  of  the  MOS's  being  considered  for  the  job.  Therefore, 
the  task  list  was  converted  to  functions  which  are  at  a  more  generic  sys  m 
performance  level.  Table  2  presents  the  list  of  23  fun-  -ns  dr-'-d  from  the 
original  tasks  of  table  1. 

Breakout  operator  functions  to  human  performance^elemen  ^“[J^jeneric^table 

The  operator  tasks  and  functions  were  next  broken  out  in  to  human 
performance  elements.  That  is,  for  each  task  or  task  aogregate,  human 
performance  components  were  determined  which  reflect  the  underlying  sensory, 
motor,  perceptual,  or  cognitive  aspects  of  the  task.  Tt^-se  were  based  on  a 
table  of  such  elements,  generated  from  larger  taxonomies  used  in  human  per¬ 
formance  studies.  Table  3  shows  the  conversions  of  the  JSTARS  functions 
and  Table  4  the  generic  human  performance  elements  pertinent  to  them. 
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JSTARS  JOB  FLOW  - - ^  OBSERVATIONS 


Monitor 

time 

Ine 


Set  up  equipment 

t 

Receive  request 


tasking 


I 


Respond  to 
radar  service 
request 


Determine 

search 

area 


•  ProceduraL  equipment  oriented 

•  Context  specific  to  radar 
system 

•  96H-10  capable  of  all  tasks 
with  current  training  base 


Situation  assessment 


of  non- 
requested 
MTI 


Detect 

pattern 

changes 


Classify 

entities 


Infer 

trends 


•  Must  depend  on  judgement 
and  background  knowledge 
and  experience 

•  Tasks  are  cognitively  demand¬ 
ing  and  not  directly  related  to 
equipment  at  hand 


Predict 

intentions 


Judge  attack  parameters 

I 


Select  points  &  sectors 


I 

Plan  &  set  priorities 

I 


reporting 


•  Targeting  must  be  directed  by 
higher  authority 

•  Can  be  viewed  as  entirely 
separate  function 


•  Job  flow  breaks  out  into  two  discrete  functions,  possibly  three 

•  Indicates  two  very  different  operator  roles,  one  at  skill  level  1 ,  one  at 
skill  level  3  or  4 
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Taili  7*  Basic  PimmoNt  ros  JSTARS  Oarsatoa  Hsins 
Oir  Consoles  on  Aiscnaet 


Bnwy  Bincnant  Tasks  Msins  ftSC  Console  (Bincnaft) 

1.  nsr  CONSOLE  f-0  ONENATION8  AND  NAINTENANCE 

7.  Identify  neohesteo  tansets  fnon  onound  level  senvice  neohests 
5.  Seavcn  and  tnacv  sfecific  tanoft 

B.  Befont  tansets  and  tanset  fananetens  (location,  length,  speed) 

5.  Pnedict  future  PTI  locations  using  F  track  processing 

6.  Maintain  cowPinrER  data  file 

7.  Fnter  FTI/SAR  reohests  to  radar  systeh  _ 

B.  WONITOR  RADAR  REQUEST  TINE  LINE 
p.  RrCERT  AND  PROCESS  RADAR  STATUS  MESSAGES 

IO.  Inform  operators  of  reouest  statuses 

IJ.  Compare  service  requests  to  radar  timeline  status 

17.  Consolidate  service  requests  for  efficient  system  tasking 
13.  Fstaslish  and  delete  specific  radar  coverage  areas  to  be  searched 
IN.  Select  and  viev  current  radar  data  by  type  and  geographic  arfa 
15-  Identify  specific  non-requested  targets  of  importancf 

If.  Bevien  historical  radar  data  using  activity  indicators,  ground 
clutter  map,  target  classifications  from  previous  FTI  and  WTI 
DETECTION  REPORTS,  FTC. 

17.  PONITOR  RADAR  PATTERNS  AND  RELATIONSHIPS 

18.  Classify  targets  of  interest 

IP.  Predict  enemy  intentions  using  classifications 

70.  Bominate  and  designate  targets  for  attack  using  a  track  processing 
7].  Track  targets 

7?.  Designate  attack  planning  areas  and  engagement  points 
73.  Fstaslish  and  delete  attack  planning  areas  to  be  searched 


Basic  Functions  j 

1.  Data  terminal  operations,  maintain  equipment  status 
7.  Identify  target  clusters,  data  terminal  ops 
3.  Search  and  track,  data  terminal  ops 

P.  BEPORT,  disseminate  via  data  link,  RADIO;  DATA  TERMINAL  OPS 
5-  Determine  if  predictive  info  needed,  data  terminal  ops 
f.  Data  management  using  system 

7.  Decide  to  give  radar  requests  to  system;  data  terminal  ops 
1r^  Monitor  reoufrts  on  timeline,  (determine  priority.) 

P.  Monitor  radar  beam  (fix  faulty  radar  ops),  data  terminal  ops 
10*  Report,  data  terminal  ops 

1).  Decide  if  timf  to  service  RFoitESTs  (time  labfling  done)  data 
terminal  ops  .  i- 

f 

1?.  Aggregate  rfouests,  data  terminal  ops 
13.  Determine  search  area,  data  terminal  ops 
lA.  Fstablish  current  baseline  picture;  data  terminal  ops 
15.  Identify,  decide  importance  of  nonreouested  f'Tls,  data  terminal 
ops 

Ifi.  Data  management  using  system,  recognition  of  pattfrns,  compari* 
SON  of  current  and  historical  data,  situation  assesshent 

17.  Data  management;  infer  relationships  based  on  patterns  and 

KNOWLEDGE 

18.  Classify  entities 
IP.  Predict  trends 

70.  Determine  candidate  targets  for  attack,  data  terminal  ops 

71.  Track  targets,  data  terminal  ops 
77.  Planning,  data  terminal  ops,  report 

73.  Pet  priorities,  search  and  track,  data  terminal  ops 
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Table  Human  Performance  Flemfnts.  Psychomotor  elements 


ARE  GENERALLY  LESS  DIFFICULT  AND  COMPLEX  THAN  EITHER  SENSORY- 
PERCEPTUAL  OR  COGNITIVE;  COGNITIVE  ELEMENTS  ARE  MOST  DIFFICULT 
ANCr  COMPLEX  OVER  SENSORY-PERCEPTUAL 


(1) 

Psychomotor 

Activate  (buttons,  switches) 

Difficulty  and  Complexity 

L( 

Adjust  -  Discrete  (knobs,  dials) 

Adjust  -  Continuous 

Manipulate  objects 

Fnter  data 

Write 

/ 

Speak  (transmit) 

High 

('?) 

Sfnsory-Pfrcfptual 

t 

Detection 

1  n 

Track  I ng 

Discrimination 

Classification 

High 

Cognitive 

Compare  and  associate 

In 

Fncodf  and  decode 

Formulate  plans  (project  actions) 

Evaluate  options 

FsTIMATE,  CALCULATE 

/ 

Predict,  infer 

High 

From  the  human  performance  literature,  it  is  known  that  tasks  expressed 
in  behavioral  terms  can  be  assessed  according  to  difficulty,  complexity,  and 
time  to  learn  (as  well  as  other  parameters).  These  types  of  assessments  are 
ratings  based  on  knowledge  of  human  sensory,  perceptual  and  cognitive 
capabilities.  A  recent  example  of  this  type  of  assessment  process  was  the 
development  of  the  workload  analysis  for  the  Army  aircrew  cockpit  database 
for  the  LHX  (Light  Helicopter  Experimental),  in  which  workload  estimates 
were  derived  in  order  to  determine  the  need  for  one  or  two  Army  €rew  members 
during  specific  missions  (Anacapa  Sciences,  Inc..  Oct  1984).  In  this  work, 
judgements  of  parameters  were  based  on  mental  processing  steps  and  capacity  of 
humans.  For  example,  response  to  sensory  stimulation  (target  detection)  is 
a  simple  processing  function  involving  discrimination  of  a  signal  from  noise. 
This  is  known  to  be  of  low  complexity  and  humans  are  relatively  good  at  it 
at  low  to  mid  noise  levels,  or  high  noise  levels  where  the  sensory  system 
has  adapted  the  display  background  to  their  functioning.  Identification  of 
a  target  (assigning  a  name)  is  of  greater  perceptual  difficulty.  Even  more 
complex  is  target  classification  which  involves  making  inferences,  drawing 
relationships,  and  planning.  Comparing  one  thing  to  another  is  considered 
of  low  level  complexity,  and  humans  excel  at  this.  As  shown  in  Table  4,  the 
human  performance  elements  are  listed  in  order  of  low  to  high  difficulty  and 
complexity,  showing  that  psychomotor  tasks  are  less  difficult  than 
sensory-perceptual,  and  cognitive  tasks  require  maximum  mental  effort.  One 
caveat  is  that  psychomotor  tasks  involve  an  initial  high  cognitive  demand 
during  learning  phase  which  quickly  drops  when  the  procedure  becomes  automatic. 

Assess  cognitive  demends  for  each  function 

Using  the  human  performance  elements  table  as  a  guide,  the  cognitive 
demands  for  each  function  were  assessed.  That  is,  for  a  particular 
function  such  as  data  terminal  o{)erati6ns,  this  consists  of  three  performance 
elements  -  activate,  adjust,  manipulate  objects.  These  are  psychomotor  and 
of  low  difficulty  and  complexity.  Therefore  the  cognitive  demand  to  perform 
the  task  is  low.  This  procedure  was  used  to  develop  cognitive  demands  for 
all  STO  functions.  The  resulting  Table  5  shows  this  assessment.  It  is  immediate 
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Basic  JSTARS  Function 


Human  Performance 


Cognitive 

flEHAND 


Data  tenminal  ops, 

HAINTAIN  EOOIPMENT 

Activate,  adjust,  mani¬ 
pulate  objects  (aamo) 

Lo 

Identtpv  target  clus¬ 
ters  DATA  TERMINAL  OPS 

Detect,  aamo,  enter  data 

Lo 

Search  and  track,  data 

TERMINAL  OPS 

Detect  track 

Lo 

Report,  disseminate  via 

DATA  LINK,  RADIO;  DATA 
TERMINAL  OPS 

Fnter  data,  speak 

Lo 

Determine  if  predictive  info 

NEEDED,  DATA  TERMINAL  OPS 
Data  management  using  system 
Decide  to  give  radar 

REQUESTS  TO  SYSTEM; 

DATA  TERMINAL  OPS 

Monitor  requests  on  time¬ 
line,  (determine  priority) 

Honitor  radar  beam  (fix 

FAULTY  radar  OPS)  DATA 
TERMINAL  OPS 

.  Report,  data  terminal  ops 
.  Decide  if  time  to  service 

REQUESTS  (time  LABELING  DONE) 
DATA  TERMINAL  OPS 

Aggregate  requests,  data 
TERMINAL  OPS 

1.  Determine  search  area, 

DATA  TERMINAL  OPS 

I.  Establish  current  baselinf 
PICTURE;  DATA  TERMINAL  OPS 

.  Identify,  decide  importance 
OF  NONREOUESTED  MTIS;  DATA 
TERMINAL  OPS 

Data  management  using 

SYSTEM,  RECOGNITION  OF 
PATTERNS 

Data  management;  infer 

RELATIONSHIPS  BASED  ON 
PATTERNS  AND  KNOWLEDGE 

I.  Classify  entities 
).  Predict  trends 


Determine  candidate  targets 

FOR  ATTACK,  DATA  TERMINAL 
OPS 

Track  targets,  data 

TERMINAL  OPS 

Planning,  data  terminal 

OPS,  REPORT 

Set  priorities,  search  and 

TRACK,  DATA  TERMINAL  OPS 


Associate,  aamo 

Fncode,  enter  data 
Aamo 

Track,  aamo 

Fncode  and  decode,  aamo 

Fnter  data,  speak 
Compare  and  associate,  aamo 

Compare  and  associate,  aamo 
Compare  and  associate,  aamo 


Medium 

Medium 


Medium 

Lo 


Compare  and  associate,  encode 

AND  decode,  infer  AAMO  MEDIUM 

Detect,  estimate,  infer 

High 

Compare  and  associate,  encode 
AND  decode,  estimate  AND 
CALCULATE,  INFER,  AAMO  HIGH 

Compare  and  associate, 

INFER,  TRACK  „ 

Medium 

Classification,  infer  track  High 

Fstimate  and  calculate, 

EVALUATE  OPTIONS,  PREDICT  HIGH 

Compare  and  associate, 

ESTIMATE,  AAMO,  EVALUATE 

High 

Track,  aamo 

LO 

Formulate  plans,  calculate  eval¬ 
uate  options,  aamo,  speak  High 

Compare  and  associate,  track, 

AAMO  Medium 


ly  obvious  that  cognitive  complexity 


increases  in  relation  to  the  break  points 


1„  op.t.to,  toU.  pr..»=o.l,  ia.ntlfl.d  in  th.  job  flow  di.,r..=  o£  £i,«r.  1. 
co.p.tl.on  o«  nos  cpabillti..  .na  .HU  Itv.l.  to 


The  thtei  noS's  unaet  consiaetation  «ot  th«  JSTASS  0  t  C  control 
opor.tor  ona  r.a.r  .v.t..  ..n.,.r  .ro  9SK  (A.tlol  Int.lli9.no.  Sp.ci.liot), 

960  (I..9..y  lnt.tpr.t.rl,  .nd  96B  (Int.llip.nc.  If"  An.lystl.  Tobl.  6 
pr...nts  .  co.pil.tlon  of  th.  critic.l  t..k  .r...  or  t.sk  for  ..ob 

HOS  .oa  .kill  I.V.I.  Th...  ....  .,9r.9.t.a  f.o.  th.  .pprov.a  .ppro..a  crit.c.1 
ta.k  li.t.  (D.C  95-O.n  86  tl..£r...l  .nd  1.0.  S«E  intorvi....  0.109  t.bl.  6  .. 
.  ,»ia.,  T.bl.  7  ...  a.v.iop.a  .hich  .ho.,  th.  c.p.biiit,  of  th.  »os’.  .. 
tt.ln.a  .nd  by  .kill  l.v.l.  to  ...t  th.  a...nd.  of  ..ch  of  th.  fohctions. 
s.v.t.l  point.  ...  imdi.t.ly  not.bl.  f.o.  th.  dot.  of  t.bl.  T. 

.  968-10  i.  ..11  qu.ll£l.d 

.  Radar  surveillance  management,  situation  assessment  functions  (tasks 
14-23)  require  operator  capability  at 
96H-40 
96D-30 
96B-20/30 

levels 

.  960  .nd  960  nOS  cutt.ntly  ...  °J‘'J'*fa5St’t?.i”S9'(ooipaJ.a''to’96Hr 
roJlI'Sr.Mo’i,.  5“^n5i"fS?  “.j;l..’'.p.cili.  AS.  ..  ..11  ..  AOf  kno.l.d,. 
and  the  aviation  qualification 

ment  through  resident  training 

.  I.., .tin,  fonctlon.,  if  app.op.i.t.  fo.  th.  function,  ..quit.  960  typ. 
of  training 


ssion;  Analysis  and  tradeoffs 


one  JSTARS  scenario  involves  -two  operators,  one  concerned  with 
processing  radar  service  requests  and  managing  the  time  line  (0  s  C  console 
operator),  and  a  higher  level  person  (radar  system  manager),  viewing  current 
and  historical  wide  area  search  data  and  providing  valued  input  to  the  Deputy 
Mission  crew  commander  and  the  GSM  operators  and  commmanders.  This  scenario 
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TABLE  7.  MOS  SKILL  LEVEL  REQUIRED  TO  PERFORri 
JSTARS  ARflY  AIRCREW  FUNCTIONS 


JSTARS  Army  Aircrew  Function 


1.  f»ATA  TrtmUAL  HAIfTTAlK  fOUIMEHT  ATATUS 

7.  iDIHTirv  TAtCET  tLllATfAS,  ®ATA  TEAHIAAL  O^S 
3,  SCAtCH  AWn  Tit  AC  1C ,  BATA  TEAM  INAL  OP$ 

H.  tCAOAT^  BIAtENIAATC  VIA  BATA  tIBK#  BADIO;  BATA  TFANINAL  OAS 
5-  ntTEtNIME  IE  EAEDICTIVE  INFO  NEEDED,  DATA  TENNINAL  OAS 
flATA  MNAEENENT  US1N6  tVSTEN 

7.  Hecide  to  «!ve  nadaa  neoiiests  to  fvsten;  data  TFANINAL  OAS 

flONITOA  NEOIIfSTR  ON  TINELINE,  (DETEANINE  AAIOAITY) 
f<OHITOA  AADAA  BEAN  (FIX  FAULTY  AADAR  OAS),  DATA  TERNINAL  OPS 
ID*  ReAORT,  data  TEANINAL  OPS 

3].  Decide  if  tinf  to  ffrvice  afouests  (tine  labeling  done)  data 

TEANINAL  OPS 

17.  AsGREGATE  AEOHESTS,  data  TEANINAL  OPS 

33.  Deteanine  neaach  area,  data  teaninal  ops 
lit.  Fbtablish  chaaent  baseline  aictuae;  data  teaninal  ops 
15.  FBENTIFY,  decide  INPORTANfE  OF  NONAEOMESTED  f^Tls,  DATA  TEANINAL 
OAS 

3f.  Data  nanagenent  using  systen,  aecosnition  of  aattfans,  conpari- 

BON  OF  CURRENT  AND  HISTORICAL  DATA,  SITUATION  ASSESSNENT 

37.  Data  nanabenent;  infer  relationships  based  on  patterns  and 

NNONLEDGE 

ID.  Classify  entities 
ID.  fREDICT  TRENDS 

70.  DeTERNINE  candidate  TARGETS  FOR  ATTACK,  DATA  TEANINAL  OPS 

73.  Track  targets,  bata  teaninal  ops 

77.  Planning,  data  teaninal  ops,  report 

73.  Set  priorities,  search  and  track,  bata  teaninal  ops 


MOS  Skill  Level  Required 


S6H  96D  95B 

1  0  0 

1  0  0 

1  0  0 

1  1  1 

1  1  1 

1  0  0 

1  0  0 

1  0  0 

1  0  0 

1  1  1 

1  0  0 

1  0  0 

1  0  0 

0  1  1 

4  3  3 

0  3  -2 

3  1  1 


0  1  1 

3  3  2 

0  0  3 

1  0  0 

0  0  4 

0  0  4 


NOTE:  A  zero  in  the  MOS  skill  level  column  indicates  no  current  MOS  capability 
to  perform  the  function  based  on  resident  and  unit  training 


assumes  that  the  Army  will  have  access  to  two  or  more  data  terminals  on  board 
the  aircraft.  It  further  assumes  that  the  Deputy  Mission  Crew  commander 
(officer  level)  will  be  only  a  casual  user  of  the  terminal.  At  the  operator 
level,  the  performance  of  the  23  or  so  functions  can  be  more  than  adequately 
handled  by  the  96H  MOS,  one  at  a  skill  level  two,  and  one  at  a  higher, 
experienced  NCO  level.  Assignment  of  the  higher  level  analytical  and 
management  functions  to  the  96D  or  96B  MOS's  requires  significant  broadening 
of  their  already  high  level  technical  expertise  in  the  imagery  interpretation 
areas  and  analysis  areas,  respectively.  The  add  on  skills  for  the  96D  and  96b 
would  involve  learning  radar  terminal  I-O,  aviation  qualification,  and  database 
management.  This  would  add  significant  time  on  to  their  already  lengthy 
resident  training.  Certainly  the  96B  should  be  eliminated  from  consideration 
since  this  would  be  diverting  the  individual  from  the  broad  scope  analytical 
training  to  a  very  system  specific  sole  source  context. 

A  second  scenario,  which  would  place  more  interpretive  and  analytical 
demands  on  the  O  s  C  console  operator  and  radar  system  manager,  would  involve 
both  individuals  in  mostly  decision  making  activities  for  predictive 
intelligence  and  targeting.  Based  on  this  analysis,  a  senior  NCO  in  the  96H 
track  can  adequately  perform  these  duties.  There  is  no  significant  difference 
in  the  skills  developed  by  a  96H  NCO  (skill  level  30  or  40)  and  a  962  wo  for 
the  duties,  so  it  is  cost  effective  to  stay  within  the  96H  track.  The  96 
enlisted  crew- member  will  be  used  as  a  valued  source  for  data,  which  will 
prioritized  by  the  deputy  mission  crew  commander  and  transmitted  via  the  SCDL 
near  real-time  down  links  to  the  ground  forces  commanders  and  GSM's.  If  this 
second  scenario  is  strongly  projected,  the  use  of  the  96D  may  need  to  be 
considered.  The  tradeoff  between  the  96H  and  the  96D  does  not  seem  worth  it 
since  the  senior  96H  has  demonstrated  the  capability  to  pick  up  these 
functions  through  OJT,  aviation,  and  combat  experience.  It  seems  that  the  best 
solution  is  to  provide  realistic ’jSTARS  scenario  types  of  stimulations  to  the 
junior  and  senior  level  96H,  in  a  CPX  and  FTX  environment,  as  part  of  the 
transition  of  the  96H  restructure  from  SLAB  to  JSTARS.  This  argues  for  a 
training  upgrade  of  the  96H  POI ,  in  order  to  develop,  in  resident  training, 
the  qualified  senior  level  analytical  skills  acquired  OJT  in  current  practice. 


Summary  of  Overall  Findings 


.  Deputy  Mission  Crew  Commander  must  be  35C  0-3  or  0-4  level  individual  to 
represent  Army  perspective  to  AF  operations  of  JSTARS 

,  96H-20  is  well  qualified  for  O  &  C  control  operation  functions 
with  only  JSTARS  specific  equipment  familiarity 

•  Radar  system  management  and  situation  assessment  functions  currently 
demand  a  96H-40,  96D-30  or  96B-20/30. 

.  96H  training  upgrade  in  analytical  skills  would  develop  qualified 
senior  level  personnel  sooner 

.  96D  JSTARS  training  on  data  terminal  and  aircraft  would  lengthen  already 
extensive  resident  training  base  by  at  least  10  weeks 

.  96  level  WO  not  required  in  lieu  of  senior  96  NCO  since  no  significant 
difference  exists  in  these  capabilities  as  required  by  JSTARS  O  &  C 
operations  or  radar  system  manager  functions 

.  Targeting  functions  may  suggest  need  for  96B  with  ASI  JSTARS,  but  this 
will  lengthen  extensive  analytical  training  to  a  specific  equipment 
context,  and  spread  MOS  definition  and  management  very  thin 
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Introduction 


Joint  STARS  (Joint  Surveillance  Target  Attack  Radar  System)  is  a 
Corps  and  Division  level  battlefield  sensor  system  designed  to  detect, 
locate,  and  track  moving  ground  targets  located  beyond  the  forward  edge 
of  the  battlefield.  Data  is  transmitted  from  airborne  systems  to  ground 
station  modules  located  at  various  points  in  support  of  Corps,  Division, 
and  Brigade  level  operations.  A  single  ground  display  station  is  known  as 
a  ground  station  module  (GSM).  Currently  the  GSM  is  configured  for  a  two 
person  primary  crew,  with  an  additional  two  workstations  for  radio-telephone 
operations  and  a  backup  workstation.  The  GSM  is  being  projected  for  near 
24  hour  operations,  necessitating  three  primary  crews:  one  per  8  hour  shift 
per  GSM. 

In  preparation  for  GSM  deployment,  certain  issues  have  been  raised  by 
the  Office  of  Chief  Military  Intelligence  (OCMI),  and  the  TSM-JSTARS, 
regarding  the  MOS  and  skill  level  appropriate  to  comprise  the  primary  crew. 
First,  what  MOS(s)  should  be  assigned  to  each  primary  crew  ?  Second,  what 
skill  level  is  the  minimum  requirement  for  each  operator  position  within  the 
primary  crew  ?  Third,  should  the  primary  crew  composition  vary  according  to 
GSM,  i.e.,  differ  if  the  GSM  is  Corps  support.  Division  support.  Brigade 
support,  or  Artillery  TOC  support  ?  The  following  report  describes  the 
Army  Research  Institute  (ARI)  analysis  conducted  to  provide  input  to  OCMI 
and  TSM-JSTARS  in  order  to  address  the  three  issues. 

Prior  to  presentation  of  the  ARI  analysis  and  findings  on  the  GSM 

crew  MOS  issues,  a  number  of  qualifications  are  put  forth: 

Although  a  number  of  96CMF  personnel  are  currently  being  trained  in 
the  JSTARS-GSM  training  facility,  the  MOS's  under  consideration  for  the 
BOIP  (Basis  of  Issue  Plan)  are  96D  (Imagery  Interpreter)  and  96H  (Aerial 
Intelligence  Specialist). 

Current  force  allocations  and  availability  of  96D  and  96H  personnel  may 


change  and  evolve  during  the  timeframe  when  JSTARS  is  fully  deployed. 
Therefore  analyses  presented  are  neither  governed  nor  constrained  by 
existing  personnel  pool. 

Training  for  the  96CMF  is  evolving  due  to  enhanced  laboratory  capability 
expected  in  the  Department  of  Surveillance  and  Systems  Maintenance 
(DSSM).  The  analyses  presented  do  not  presume  to  represent  changes  in 
skill  acquisition  that  will  result  in  the  future  POlCprogram  of  instruction). 

Approach 

The  approach  taken  in  the  ARI  analysis  of  GSM  primary  crew  MOS  issues 
consisted  of  a  step  by  step  compilation  of  task,  functions,  and  skill  demands 
projected  for  the  operator  positions  in  the  GSM,  followed  by  a  matching 
process  to  relate  the  system  demands  to  current  MOS  capabilities.  Data 
gathering  consisted  of  document  reviews  and  interviews  with  subject  matter 
experts  (SME's)  to  derive  system  requirements.  Following  this  a  task  and 
function  listing  was  developed  and  matched  to  MOS  descriptions  provided 
by  critical  task  lists,  soldier's  manuals,  and  AR  611-201.  Human  performance 
capabilties  to  perform  functions  were  taken  from  psychological  literature 
indicating  task  difficulty,  complexity,  and  cognitive  demand.  The  results 
of  the  analysis  is  presented  below. 

Data  gathering  on  GSM  operator  requirements 

SME's  from  the  TSM- JSTARS  (CPT  Drain)  and  PM  JSTARS  -Army  (Mr.  Dave 
Usachek,  Deputy  PM)  were  interviewed.  In  addition,  detailed  review  was 
conducted  of  the  JSTARS  ROC  (Required  Operational  Capability),  A  level 
system  specification.  Downsized  GSM  A  specification,  and  GSM  Operations 
Menu  specification.  Also,  recent  articles  such  as  "Integrated  Radar 
Expected  to  Be  Operational  by  1990's"  (ARMY  TIMES,  OCT  20,  1986),  and 
similar  write  ups  in  the  ARMY  GREEN  BOOK  (1985-86),  were  noted.  The 
system  capabilities  allow  for  operator  workstations  to  accomodate  the 
following  positions: 

TSS  -  Target  Surveillance  Supervisor 

STO  -  Search  Track  Operator 


:  RTO  -  Radio  Telephone  Operator 

A  single  GSM  configuration  consists  of  one  TSS  and  one  STO,  with  RTO 
while  a  dual  full  crew  GSM  consists  of  one  TSS,  two  STO's  and  one  RTO 
per  workstation.  The  single  GSM  configuration,  with  two  operator  primary 
crew,  is  the  core  of  any  given  shift's  operations.  The  e  tem  will  not  allow 
login  to  exceed  the  possible  positions  available,  that  is  the  dual  GSM 
configuration  would  accept  only  two  STO  logins  and  then  r^^uire  a  TSS  and 
RTO  to  follow.  The  single  GSM  configuration  allows  for  a  TSS  and  STO  as 
primary  crew. 

The  GSM  is  primarily  conceived  to  process  MTI  (mo,  target  indicator) 
data,  however  advanced  concepts  indicate  possible  integr;-  n  of  data  from 
other  IMINT  sources  (such  as  electro  optical,  infrared),  or  even  corollary 
SIGINT  sources.  This  would  mean  receipt  and  processing  of  data  from 
other  sensors  either  on  separate  or  split  screen,  or  integrated  into  the  MTI 
data  base  for  call  up.  Also,  the  threat  projections  provide  a  busy  picture  of 
MTI  data  alone  during  scenarios  in  certain  circumstances  Given  this  data, 
it  is  clear  that  manipulation  of  MTI  data  is  only  a  part  of  the  overall 
GSM  mission.  Table  1  is  a  list  of  task  categories  and  sul  asks  as  derived 
for  operators  in  the  GSM  primary  crew.  It  is  immediately  obvious  that  there 
is  a  progression  of  tasks  from  simple  data  terminal  operations  (Tasks  1—5), 
to  file  creation  and  review  for  battle  management  and  ta: ''eting  activities 
(Tasks  6-10).  In  addition,  coodination  and  supervisory  tasks  are  critical  to 
the  overall  workflow  since  it  will  be  virtually  impossible  to  focus  on  a 
single  MTI  processing  task  and  simultaneously  assess  total  target  priorities 
and  patterns  from  a  larger  perspective  (Tasks  11-16).  Also,  the  GSM,  having 
many  data  links  to  other  C3I  nodes,  requires  the  bigger  picture  perspective 
at  all  times  for  coodinations  and  efficient  use  of  data.  A  STO  is  likely  to 
spend  the  majority  of  the  shift  on  the  primary  data  terminal  operations 
(Tasks  1-7),  and  only  situation  coordination  interface  functions  as  backup 
in  a  degraded  mode.  Figure  1  graphically  presents  a  single  GSM  workflow. 


Table ' 1 .  JSTARS  GSM  tasks  for  TSS ,  STO ,  and  RTO 


1.  Power  up  and  operate  console  workstation  —  logon  and  status  checks 

2.  Establish  appropriate  communications  network(s) 

3.  Task  sensor  beam  via  data  link  to  sensor  platform 

4.  Locate  and  identify  specific  MTI's  according  to  tasking 

5.  Search  and  track  specific  MTI's 

6.  Manipulate  data  in  assigned  area  of  operations 

a.  Operate  display  scale,  recenter  capability 

b.  Review  masked  areas 

c.  Operate  time  compression  and  time  integration  modes 

d.  Develop  and  maintain  graphic  overlays 

7.  Develop  target  files 

a.  Identify  targets  of  interest 

b.  Store/display  targets 

c.  Predict  target  characteristics  -  e.g.  location,  speed 

d.  Autotrack  selected  targets 

8.  GSM  system  management 

a.  Develop  target  status,  summary  files 

b.  Correlate  GSM  data  into  message  data  log  from  TAGFIRE,  SIGMA,  etc. 

9.  Integrate  and  interpret  alternative  sensor  source  data  (UAV,  IR,  etc.) 

a.  Accept  and  review  single  sensor  (non-MTI)  data  files 

b.  Select  and  display  multisensor  inputs  (split  screen,  dual  screen) 

c.  Create  integrated  situation  database 

d.  Develop  predictive  intelligence 

e.  Develop  specific  target  parameters 

10.  Message  processing 

a.  Formulate  messages  according  to  prescribed  formats 

b.  Develop  message  logs 

c.  Transmit  messages 

11.  Coordinate  data  files  with  other  GSM  data  in  AO 

12.  Review  data  files  of  STO  terminal(s) 

13.  Review  STO  target  files 

14.  Develop  expanded  target  summary  files 

15.  Assign  target  priorities 

16.  Predict  target  parameters 

17.  Display  I/O  messages 

18.  Display  system  equipment  statuses  of  subsystems 

19.  Formulate  and  transmit  communication  messages 

20.  Maintain  master  message  log 


1.  Workflow  Diagram  for  JSTARS  GSM 
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/  . 

Review  imagery  files  Rev^iew  target  files 

Decide  importance  of  Develop  expanded  target  summaries 
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1 
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«h6\?ing  the  progression  from  STO  to  TSS  tasks.  An  overlap  of  responsibility 
is  apparent  in  the  transition  from  tasks  8-11,  that  is,  no  indication  is 
obvious  which  are  purely  STO  and  which  are  purely  TSS.  The  RTO  function 
(Tasks  17-20),  is  presented  at  the  bottom  for  completeness  although  not 
considered  part  of  the  two  person  primary  crew. 

Analysis  of  GSM  task  demands 

The  GSM  task  list  of  Table  1  was  converted  to  functions  as  shown  in 
Table  2.  This  provided  a  basis  to  decompose  functions  into  human  performance 
components.  From  these,  tasks  were  assessed  for  mental  (cognitive)  complex¬ 
ity  and  difficulty.  Table  3  shows  the  STO  and  TSS  functions  expressed  in 
their  underlying  human  performance  components.  Human  performance  literature 
indicates  that  functions,  such  as  data  terminal  operations,  analysis  of 
entities,  report  preparation,  etc.  consist  of  a  finite  set  of  behaviors 
that  range  from  simple  psychomotor  tasks  to  complex  mental  calculations 
and  searches.  A  set  of  these  behaviors  is  listed  in  Table  4,  showing  the 
range  from  the  simple  to  the  complex,  and  the  categories  of  each.  The  four 
categories  show  that  level  of  difficulty  increases  from  simple  psychomotor 
tasks  to  complex  cognitive  interactive  tasks.  For  example,  detection  of  a 
target  on  a  screen  is  a  perceptual  task  of  low  difficulty  for  a  human,  while 
prediction  of  intention  is  a  complex  cognitive  task  requiring  extensive 
mental  work.  Note  that  supervisory  work  is  distinguished  from  individual 
cognitive  tasks  in  that  it  involves  interpersonal  activities  and  decision 
making  of  an  even  greater  cognitive  complexity  than  that  for  a  single 
individual . 

Using  tables  3  and  4  as  a  guide,  the  cognitive  demands  for  the  GSM 
functions  were  assessed.  That  is  for  a  particular  function,  such  as  data 
terminal  operations,  this  consists  of  three  human  performance  elements  - 
activate,  adjust,  manipulate  objects.  These  are  psychomotor  and  of  low 
difficulty  and  complexity.  Therefore  the  cognitive  workloewi  for  the  task 


Table  2.  Basic  Functions  of  JSTARS  GSM  Operators 


Task  # 


1 

2 

3 

4 

5 

6 

7 


8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


Function 


Data  Terminal  Operations,  maintain  equipment  status 
Radio  and  digital  data  link  operations 
Data  Terminal  Operations 

Identify  target  clusters,  data  terminal  operations 
Search  and  track,  data  terminal  operations 
Determine  appropriate  search  windows,  decide  situation 
parameters,  review  and  compare,  data  terminal  operations 
Identify  targets,  determine  target  parameters,  identify 
target  characteristics,  determine  importance  of  selected 
targets,  track  selected  targets,  data  terminal  operations 
Data  management  using  system:  Aggregate  past  data, 
correlate  various  sources,  data  terminal  operations 
Review  non-MTI  data,  compare  inputs,  create  new  situation 
display 

Receive  new  data,  develop  data  transaction  log,  transmit 
messages,  data  terminal  operations 

Decide  importance  and  relationship  of  correlary  GSM  data 
to  current  A/0  database 

Review  and  monitor  STO  data  processing  —  battle  management 

Review  and  monitor  STO  data  processing  -  targeting 

Develop  candidate  high  priority  targets 

Prioritize  targets 

Predict  target  intentions 

Operate  RTO  screen 

Review  and  monitor  eqiupment  operations 

Communicate  with  outside  entities  -  Radio  +  equipment  ops 
Maintain  accurate  message  log 


Table  3.  Human  Performance  Components  of  JSTARS  GSM  Functions 
Task  and  Function  #  Human  Performance  Component 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


Activate,  adjust,  manipulate  objects  (aamo) 
Aamo 

Enter  data,  transmit 
Detect,  track,  aamo 
Track ,  aamo 

Evaluate  options,  compare  and  associate, 
estimate,  manipulate  objects 
Detect,  calculate,  discriminate,  infer, 
track,  aamo 

Compare  and  associate,  encode  and  decode, 
SLSiino 

Compare  and  associate,  encode  and  decode, 
infer,  classify,  predict,  aamo 
Detect,  compare  and  associate,  transmit 
Compare  and  associate,  infer,  interact  with 
higher  authority 

Review  procedural  tasks,  review  results, 
monitor  progress,  aamo 

Review  procedural  tasks,  review  results, 

monitor  progress,  aamo 

Decide  importance  of  results 

Prioritize  results 

Predict,  infer 

Aamo 

Aamo ,  compare 
Enter  data,  transmit 
Aamo,  enter  data 


Table  4.  Human  Performance  Elements 


Note : 


type  difficulty 


PSYCHOMOTOR 

Activate  (buttons,  switches)  LO 

Adjust  -  discrete  (knobs,  dials) 

Adjust  -  continuous 
Manipulate  objects 
Enter  data 
Write 


Speak  (transmit) 

HIGH 

SENSORY-PERCEPTUAL 

Detection 

U 

Tracking 

Discrimination 

Classification 

h: 

;gh 

COGNITIVE  -  INDIVIDUAL 

Compare  +  Associate 

LO 

1 

Encode  +  Decode 

Formulate  Plans  (Project  actions) 

Evaluate  options 
Estimate,  calculate 

Predict,  infer  VERY  HI 

COGNITIVE  -  INTERPERSONAL  +  SUPERVISORY 

Review  procedural  tasks  MODERATE 

Review  results  of  actions 

Monitor  progress 

Decide  importance  of  results 

Prioritize  findings  1 

Interact  with  higher  authority  VERY  HI 


Psychomotor  elements  are  generally  less  difficult 
either  sensory-perceptual  or  cognitive;  cognitive 
difficult  and  complex  over  sensory. 


+  COMPLEXITY 


and  complex  than 
elements  are  most 


•is  low.  Table  5  shows  the  breakout  of  functions  by  cognitive  demand.  The 
STO  tasks  (1-7),  are  clearly  less  demanding  than  those  of  the  TSS  (11-16), 
and  if  both  operator  roles  are  critical  to  GSM  operations,  than  at  least  one 
of  each  will  be  required  per  GSM  per  shift  to  insure  accomplishment  of  the 
workflow.  The  overlap  or  transitioi  tasks  (8-11),  require  a  higher  skill 
level  STO  or  a  dedicated  TSS  with  deeriphasis  on  supervisory  activity. 

MOS  capability  comparison  to  GSM  demands 

Two  MOS's  are  under  consideration  for  assignment  to  the  GSM  STO 
and  TSS  positions:  96D  and  96H.  Table  6  is  a  digest  of  critical  task 
aggregates  representing  acquired  skills  as  trained  and  developed  in 
resident  and  unit  experience.  Common  soldier  skills  and  aviation  training 
(96H)  are  not  included.  With  the  task  aggregates  of  Table  6,  Table  7  was 
developed  matching  GSM  demands  to  available  skills  and  skill  levels  within 
the  two  MOS's.  The  numbers  in  the  MOS  columns  indicate  skill  level  required 
to  perform  the  functions,  and  a  zero  indicates  that  the  MOS  as  trained  is 
not  equipped  to  perform  the  function. 

Discussion:  Analysis  of  findings 

Table  7  reveals  the  capability  of  96H  10  and  20  to  perform  only  minimal 
functions  within  the  GSM  (Tasks  1-6).  Although  both  96H  10  and  20  have  worked 
with  MTI  data  in  current  operations,  the  performance  of  the  function  is  more 
equipment  oriented  than  analysis  oriented.  Few  specific  analysis  skills 
are  trained  in  the  current  96H  track,  and  senior  level  96H  (30  and  40) 
possess  these  skills  only  incidentally  through  combat  experience  situations. 
Senior  level  96H  personnel  are  provided  supervisory  training,  however, 
and  it  is  evident  that  their  ability  to  coordinate  findings  and  make 
decisions  is  part  of  becoming  an  NCO.  The  96D  individual  is  more  capable 
at  a  lower  skill  level,  to  assume  the  tasks  of  the  STO  for  the  Tasks  6-11, 
within  the  GSM.  With  the  projected  activity  level  for  any  given  workstation 


Table  5.  Cognitive  demands  of  JSTARS  GSM  Functions 


Task  # 


1 

2 

3 

4 

5 

6 


7 


8 


9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


Function 


Cognitve  Demand 


Data  Terminal  Operations, 

maintain  equipment  status 

Radio  and  digital  data  link  operations 

Data  Terminal  Operations 

Identify  target  clusters, 

data  terminal  operations 

Search  and  track,  data  terminal  operations 
Determine  appropriate  search  windows, 
decide  situation  parameters, 

review  and  compare,  data  terminal  operations 
Identify  targets,  determine  target  parameters, 
identify  target  characteristics, 
determine  importance  of  selected  targets, 
track  selected  targets,  data  terminal  operations 
Data  management  using  system: 

Aggregate  past  data,  correlate  various  sources, 
data  terminal  operations 
Review  non-MTI  data,  compare  inputs, 
create  new  situation  display 

Receive  new  data,  develop  data  transaction  log, 
transmit  messages,  data  terminal  operations 
Decide  importance  and  relationship  of 
correlary  GSM  data  to  current  A/0  database 
Review  and  monitor  STO  data  processing 

-  battle  management 

Review  and  monitor  STO  data  processing 

-  targeting 

Develop  candidate  high  priority  targets 
Prioritize  targets 
Predict  target  intentions 
Operate  RTO  screen 

Review  and  monitor  eqiupment  operations 
Communicate  with  outside  entities 

-  Radio  +  equipment  ops 
Maintain  accurate  message  log 


LO 

LO 

LO 

LO 

LO 


MODERATE 


HIGH 


MODERATE 

VERY  HI 

MODERATE 

HIGH 

VERY  HI 

VERY  HI 

HIGH 

HIGH 

HIGH 

LO 

LO 

LO 

LO 


Table  6.  KOS  Task  Aggregates  of  Qualifications  and  Skill  Levels, 
derived  from  AR  611-201,  critical  task  lists,  and  other 
sources  (excluding  common  soldier  tasks)  for  96H  and  96D. 


96H 


96D 


Skill  Level  1 

Plan  specific  surveillance 
mission  (SLAR,  IR,  PHOTO) 


Visually  acquire  targets 
Identify  and  plot  targets 

Perform  system  maintenance 
checks 

Data  terminal  operations: 

Prepare  terminal  for  ops 
Operate  terminal 
Identify  and  plot  targets 
Prepare  terminal  for  display 
Perform  maintenance  checks 

Aviation  qualifications 
Interpret  threat  to  aircraft 
Performs  radio  communications 

Skill  Level  2 

Supervise  procedural  task 
performance  on  Skill  level  1 
tasks 

Assist  imagery  analyst 


Skill  Level  3 

Supervise  overall  mission 
planning  for  SLAR,  IR,  PHOTO 

Select  site  for  data  term 


Skill  Level  1 

Photogrammetry :  determine  distances 

Identification:  identify  entities 

Analysis:  use  imagery  analysis 
principles  to  analyze  sectors  using 
IR,  Radar 

Mission  Planning:  prepare  sitmap  and 
overlays 

Determine  imagery  coverage 
Give  aircrew  brief 

Obtains  information  of  intel  value 
Prepares  reports  and  briefs  per  SOP 


Skill  Level  2 
Mission  planning: 

Use  R&S  capabilities  for  planning 
Select  zones  of  entry 

Prepares  and  maintains  enemy  sitmap 
Determines  physical  features  of  terrain 
and  enemy  instal lations , deployments , 
weapons,  equipment,  defenses,  commo 

Photogrammetry:  measure  oblique  and 
panoramic  images 

Studies  and  analyzes  imagery  produced 
by  aerial  sensors  systems 

Skill  Level  3 

Collection  management: 

Plan  GSR  mission,  brief  mission  team 
Prepare  R£?S  plan,  process  AS5?R  request 
Relate  other  "INTS"  to  IMINT 


deployment 

Assist  in  plan  and  manage  of 
aerial  surveillance  systems 

Assist  imagery  analyst  in 
enemy  parameter  id 

Conducts  sit  briefs  to  cdr 


Skill  Level  4 

Supervise  overall  tasks 
of  skill  levels  1-3: 

Assign  duties,  schedule 
Supervise  operations  of 
section 

Review  and  critique 
mission  results  of  section 

Direct  training  for  tasks 
in  skill  levels  1-3 

Manage  OV-ID/RV-ID  S^R 
assets 

Coordinate  commo  with 
other  nodes 

Keep  overall  mission 
status  log 

Advise  cdr  on  interface  of 
aerial  surveillance  with 
ground  surveillance 


Receive  and  review  and  disseminate 
mission  results 

Imagery  analysis: 

Perform  overall  analysis  of  ground 
forces 

Quality  check  imagery  reports  and 
analyses  of  subordinates 

Prepares  and  maintains  target  folders 

Skill  Level  4 

Supervise  RG?S  Plan  preparation 

Coordinate  collection  with  other  nodes 

Review  ADP  files  for  input  to  imagery 
database 

Instructs  subordinates  in  proper 
techniques  and  procedures  for  II 

Performs  secondary  quality  control 
of  II  analysis  to  determine  accuracy 
validity,  completeness 

Assists  in  planning  for  utilization 
of  air  and  ground  R£?S  sensor  systems 


Table  7.  JSTARS  GSM  Functions  X  MOS  Capability 
Task  #  Function 


MOS  Skill  Level 
Requirement 

96H  96D 


1 

2 

3 

4 

5 

6 


7 


8 


9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


Data  Terminal  Operations, 

maintain  equipment  status 

Radio  and  digital  data  link  operations 

Data  Terminal  Operations 

Identify  target  clusters, 

data  terminal  operations 

Search  and  track,  data  terminal  operations 
Determine  appropriate  search  windows, 
decide  situation  parameters, 

review  and  compare,  data  terminal  operations 
Identify  targets,  determine  target  parameters, 
identify  target  characteristics, 
determine  importance  of  selected  targets, 
track  selected  targets,  data  terminal  operations 
Data  management  using  system: 

Aggregate  past  data,  correlate  various  sources, 
data  terminal  operations 
Review  non-MTI  data,  compare  inputs, 
create  new  situation  display 

Receive  new  data,  develop  data  transaction  log, 
transmit  messages,  data  terminal  operations 
Decide  importance  and  relationship  of 
correlary  GSM  data  to  current  A/0  database 
Review  and  monitor  STO  data  processing 

-  battle  management 

Review  and  monitor  STO  data  processing 

-  targeting 

Develop  candidate  high  priority  targets 
Prioritize  targets 
Predict  target  intentions 
Operate  RTO  screen 

Review  and  monitor  eqiupment  operations 
Communicate  with  outside  entities 

-  Radio  +  equipment  ops 
Maintain  accurate  message  log 


1 

0 

1 

1 

1 


2 


0 


0 

0 

1 

4 

3 

3 

4 
3 
0 
1 
1 

1 

1 


0 

0 

0 

0 

0 


1 


2 


2 

3 

2 

3 

3 

3 

3 

3 

3 

0 

0 

0 

0 


Note:  A  zero  in  the  MOS  column  indicates  no  present  capability  of  the 
MOS  as  trained  to  perform  the  function 


-WitK'in  the  GSM  network,  it  appears  that  the  knowledge  of  enemy  order  of 
*  battle,  battlefield  entities  and  patterns,  and  integration  of  this  with  the 
emerging  MTI  picture,  is  more  adeptly  handled  by  the  96D.  It  is  important  to 
note  that  the  current  training  of  the  96D  is  not  system  specific  nor  equipment 
oriented  (Tasks  1-5).  This  means  that  attention  will  have  to  be  devoted  to 
this  in  GSM  training.  While  on  the  surface  it  appears  that  the  96D  is  the 
obvious  choice  for  GSM  operations,  both  in  the  supervisory  and  operator 
positions,  final  judgement  rests  on  acceptance  of  which  of  two  scenarios  is 
most  likely:  One  JSTARS  scenario  projects  use  of  MTI  data  as  the 
primary  mission  and  function  of  the  GSM,  and  that  other  iriput  sources  are 
secondary  or  conjecture  for  planning  purposes.  In  this  case,  since  the 
96H  has  to  date  worked  with  a  radar  terminal  dedicated  to  this  MTI  medium 
(Tasks  1-5),  it  is  possible  that  the  training  to  be  provided  in  the  GSM 
trainer  could  introduce  and  enhance  analytical  skills  (Tasks  6-10)  ne^^ded  to 
function  in  the  fielded  GSM  environment.  Certainly  the  seasoned  96H  NCO 
could  adapt  to  the  demands  of  the  TSS  tasks  (11-16)  and  perform  interface 
and  decision  making  functions  as  prescribed.  An  assumption  is  made  that  the 
training  in  the  GSM  trainer  will  provide  sufficient  realistic,  scenario-based 
stimulation  to  engender  the  required  skills  in  battle  m.anagement  and 
targeting.  A  second  scenario  holds  that  the  fielded  JSTARS  GSM  will  be  an 
advanced  technological  workstation  processing  multiple  NT  and  possibly 
SIGINT  inputs  in  an  integrated  way.  This  will  mean  that  a  96D  would  certainly 
be  best  equipped  to  go  beyond  simple  identifications  and  transmissions 
(STO  Tasks  1-7)  and  interject  considerable  analysis  of  battlefield  entities 
and  target  situations  (STO-TSS  Tasks  8-11).  Although  considerable  time 
and  effort  is  spent  in  providing  training  to  96D  personnel  which  allow  for 
analysis  and  predictive  capability,  the  individuals  are  not  particularly 
equipment  oriented  or  geared  toward  a  radar  workstation  environment.  Again, 
the  POI  within  the  GSM  training  facility  provides  this,  however  it  is  an 
add  on  to  their  already  lengthy  and  difficult  resident  training.  It  appears 


;th&Withe  question  is  whether  to  add  the  difficult  analytical  skills  to  lower 
level  96H  personnel  or  add  data  terminal  operation  system-specific  skills 
to  the  96D  AIT  curriculum.  Once  the  supervisory  level  is  reached,  the  NGO  of 
either  track  (96H30  or  96D30)  is  suitable. 


Conclusions  and  recommendations 


Returning  to  the  MOS  issues  raised  in  the  introductory  section  of  this 
report,  several  questions  were  raised.  The  conclusions  reached  are  based  on 
the  necessity  for  the  primary  crew  to  consist  of  at  least  one  STO  and  one 
TSS  in  order  to  perform  the  system  functions.  The  preceding  analysis  and 
discussion  leads  to  the  following  conclusions: 

1)  MOS  Assignment  to  primary  crew  per  shift  -  The  96D  20  is  recommended  to 
perform  the  STO  tasks  to  include  data  manipulation  required  for  tasks  1-10. 

A  96D  30  TSS  should  be  available  on  all  shifts  to  accomplish  the  higher 
level  tasks  11-16.  The  96H  does  not  currently  have  the  skills  to  manage  the 
critical  operator  tasks  8-11  which  are  required.  Only  an  intensive  training 
and  simulation  environment  could  hope  to  cultivate  the  required  skills  and 
reorient  the  POI  of  the  96H  to  a  more  analytical  base. 

2)  Minimum  skill  level  requirement  for  each  position  - 

STO:  skill  level  20;  TSS:  skill  level  30.  Could  exceed  in  each  case  but  this 
would  be  a  misuse  of  personnel  for  any  given  shift.  If  a  higher  level  TSS 
skill  level  40/50  is  available  for  cross  shift  personnel  management,  and 
co-performs  TSS  single  shift  duties,  this  is  a  different  matter. 

3)  Crew  composition  by  GSM  (Division,  Corps)  -  Since  threat  projections 
indicate  a  busy  environment  for  the  Division  but  an  even  busier  role  for 
the  Corps,  a  back  up  STO  (skill  level  20)  is  recommended  for  the  Corps 
level  GSM,  not  additional  supervisory  personnel.  This  is  because  the  work 
within  the  GSM  is  primarily  workstation  oriented,  and  concerns  manipulation 
of  data  at  a  terminal,  which  is  then  overseen  and  findings  prioritized  by 

a  supervisor.  One  NGO  per  shift  and  more  operators  who  develop  initiative 
and  proficiency  is  the  most  efficacious  crew  model. 


